-- Logs begin at Tue 2022-09-06 00:32:21 UTC, end at Tue 2022-09-06 01:36:22 UTC. -- Sep 06 01:03:14.458692 dv-cinder-847732-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 06 01:03:14.466822 dv-cinder-847732-2-iscsi devstack@n-api.service[105586]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 06 01:03:14.469900 dv-cinder-847732-2-iscsi devstack@n-api.service[105586]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 6 01:03:14 2022] *** Sep 06 01:03:14.469900 dv-cinder-847732-2-iscsi devstack@n-api.service[105586]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 06 01:03:14.469900 dv-cinder-847732-2-iscsi devstack@n-api.service[105586]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 06 01:03:14.469900 dv-cinder-847732-2-iscsi devstack@n-api.service[105586]: nodename: dv-cinder-847732-2-iscsi Sep 06 01:03:14.469900 dv-cinder-847732-2-iscsi devstack@n-api.service[105586]: machine: x86_64 Sep 06 01:03:14.469900 dv-cinder-847732-2-iscsi devstack@n-api.service[105586]: clock source: unix Sep 06 01:03:14.469900 dv-cinder-847732-2-iscsi devstack@n-api.service[105586]: pcre jit disabled Sep 06 01:03:14.469900 dv-cinder-847732-2-iscsi devstack@n-api.service[105586]: detected number of CPU cores: 4 Sep 06 01:03:14.469900 dv-cinder-847732-2-iscsi devstack@n-api.service[105586]: current working directory: / Sep 06 01:03:14.469900 dv-cinder-847732-2-iscsi devstack@n-api.service[105586]: detected binary path: /usr/bin/uwsgi-core Sep 06 01:03:14.469900 dv-cinder-847732-2-iscsi devstack@n-api.service[105586]: your processes number limit is 47680 Sep 06 01:03:14.470557 dv-cinder-847732-2-iscsi devstack@n-api.service[105586]: your memory page size is 4096 bytes Sep 06 01:03:14.470557 dv-cinder-847732-2-iscsi devstack@n-api.service[105586]: detected max file descriptor number: 2048 Sep 06 01:03:14.470557 dv-cinder-847732-2-iscsi devstack@n-api.service[105586]: lock engine: pthread robust mutexes Sep 06 01:03:14.470557 dv-cinder-847732-2-iscsi devstack@n-api.service[105586]: thunder lock: enabled Sep 06 01:03:14.470557 dv-cinder-847732-2-iscsi devstack@n-api.service[105586]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 06 01:03:14.470557 dv-cinder-847732-2-iscsi devstack@n-api.service[105586]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 06 01:03:14.511055 dv-cinder-847732-2-iscsi devstack@n-api.service[105586]: Python main interpreter initialized at 0x56313e6d39c0 Sep 06 01:03:14.511055 dv-cinder-847732-2-iscsi devstack@n-api.service[105586]: python threads support enabled Sep 06 01:03:14.511055 dv-cinder-847732-2-iscsi devstack@n-api.service[105586]: your server socket listen backlog is limited to 100 connections Sep 06 01:03:14.511055 dv-cinder-847732-2-iscsi devstack@n-api.service[105586]: your mercy for graceful operations on workers is 90 seconds Sep 06 01:03:14.511462 dv-cinder-847732-2-iscsi devstack@n-api.service[105586]: mapped 403077 bytes (393 KB) for 2 cores Sep 06 01:03:14.511462 dv-cinder-847732-2-iscsi devstack@n-api.service[105586]: *** Operational MODE: preforking *** Sep 06 01:03:14.511740 dv-cinder-847732-2-iscsi devstack@n-api.service[105586]: *** uWSGI is running in multiple interpreter mode *** Sep 06 01:03:14.511740 dv-cinder-847732-2-iscsi devstack@n-api.service[105586]: spawned uWSGI master process (pid: 105586) Sep 06 01:03:14.511973 dv-cinder-847732-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 06 01:03:14.512540 dv-cinder-847732-2-iscsi devstack@n-api.service[105586]: spawned uWSGI worker 1 (pid: 105587, cores: 1) Sep 06 01:03:14.512872 dv-cinder-847732-2-iscsi devstack@n-api.service[105586]: spawned uWSGI worker 2 (pid: 105588, cores: 1) Sep 06 01:03:14.513016 dv-cinder-847732-2-iscsi devstack@n-api.service[105586]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 06 01:03:15.169376 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 06 01:03:15.171288 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 06 01:03:16.248192 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 01:03:16.248192 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: from cryptography.utils import int_from_bytes Sep 06 01:03:16.248781 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 01:03:16.248781 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: from cryptography.utils import int_from_bytes Sep 06 01:03:16.248781 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 01:03:16.248781 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: from cryptography.utils import int_from_bytes Sep 06 01:03:16.249278 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 01:03:16.249278 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: from cryptography.utils import int_from_bytes Sep 06 01:03:18.715510 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 01:03:18.716087 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 01:03:18.716301 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 01:03:18.716663 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 01:03:18.716915 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 01:03:18.717299 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.717626 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.717946 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.718263 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.718456 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 01:03:18.718801 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.718882 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 01:03:18.718991 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.719191 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.719293 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 01:03:18.719505 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.719591 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 01:03:18.719853 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.719943 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 01:03:18.720114 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.720243 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.720429 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.720570 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.720756 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847732-2-iscsi {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.720881 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.721073 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.721204 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.721376 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.721530 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.721684 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.721840 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.721999 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.722162 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.722303 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.722484 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.722622 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.722810 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.722927 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.723074 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.723390 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.723486 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.723715 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847732-2-iscsi {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.724662 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.724769 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.724852 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.724938 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.725032 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.725165 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.725247 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.725324 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.725450 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.725542 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.725628 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.725821 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.726409 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.726544 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.726846 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.726939 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.727173 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.727266 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.727489 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.727588 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.727840 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.727929 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847732-2-iscsi {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.728182 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.728281 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.728501 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.728594 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.728812 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.728896 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.729131 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.729225 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.729444 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.729540 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.729769 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.729854 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.730082 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.730178 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.730428 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.730540 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847732-2-iscsi {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.730737 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.730837 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.731064 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.731171 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.731381 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.731477 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.731699 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.731801 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.732045 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.732131 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.732347 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.732443 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.732654 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.732788 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.732964 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.733050 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.733281 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.733369 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.733586 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.733715 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.733890 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.733976 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.734140 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.734236 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.734445 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.734558 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.734762 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.734854 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.735083 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.735170 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.735402 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.735498 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.735652 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.735778 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.735927 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.736080 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.736246 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.736387 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.736564 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.736661 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.736871 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.736969 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.737177 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.737264 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.737488 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.737576 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.737793 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.737879 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.738095 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.738180 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.738348 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.738442 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.738669 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.738761 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.738981 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.739065 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.739288 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.739376 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.739598 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.739682 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.739931 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.740030 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.740243 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.740328 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.740549 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.740635 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.740883 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.740978 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.741196 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.741295 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.741499 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.741591 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.741813 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.741907 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.742130 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.742222 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.742434 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.742529 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.742749 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.742844 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.743068 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.743154 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.743370 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.743454 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.743675 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.743849 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.744009 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.744103 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.744325 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.744460 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.744654 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.744749 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.744958 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.745051 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.745207 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.745299 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.745506 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.745593 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.745808 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.745894 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.746123 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.746216 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.746425 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.746511 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.746728 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.746822 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.747031 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.747130 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.747329 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.747414 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.747617 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.747712 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.747947 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.748052 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.748248 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.748333 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.748551 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.748643 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.748855 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.748949 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.749158 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.749254 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.749461 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.749549 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.749762 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.749856 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.750064 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.750147 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.750365 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.750450 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.750670 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.750766 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.750978 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.751064 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.751281 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.751378 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.751582 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.751677 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.751907 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.752006 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.752210 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.752295 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.752515 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.752614 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.752819 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.752905 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.753121 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.753208 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.753441 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.753527 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.753745 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.753859 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.754048 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.754146 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.754355 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.754448 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.754658 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.754745 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.754962 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.755056 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.755273 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.755358 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.755571 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.755654 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.755901 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.755993 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.756723 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.756858 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.757031 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.757116 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.757336 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.757422 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.757638 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.757726 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.757943 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.758034 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.758245 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.758331 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.758550 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.758636 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.758849 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.758933 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.759152 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.759246 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.759451 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.759547 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.759774 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.759861 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.760084 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.760182 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.760389 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.760476 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.760693 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.760778 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.760997 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.761091 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.761311 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.761444 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.761669 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.761775 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.761904 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.762005 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.762223 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.762316 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.762545 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.762631 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.762852 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.762947 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.763159 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.763283 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.763464 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.763550 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.763813 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:03:18.763906 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.764146 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.764233 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.764472 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.764561 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.764787 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.764883 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.765098 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.765184 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.765410 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.765509 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.765726 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.765813 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.766043 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.766130 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.766369 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.766528 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.766711 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.766804 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.766999 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.767106 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.767311 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.767410 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.767621 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.767706 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.767957 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.768044 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.768277 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.768371 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.768597 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.768682 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.768911 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.768997 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.769233 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.769334 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.769557 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.769644 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.769879 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.769980 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.770196 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.770300 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.770512 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.770598 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.770821 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.770907 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.771132 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.771219 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.771441 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.771539 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.771802 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.772507 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.772679 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.772777 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.772993 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.773081 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.773314 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.773400 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.773625 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.773720 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.773942 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.774029 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.774252 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.774338 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.774563 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.774651 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.774908 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.775043 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.775183 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.775278 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.775491 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.775577 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.775849 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.775938 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.776165 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.776268 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.776486 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.776571 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.776799 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.776883 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.777107 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.777200 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.777419 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.777505 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.777734 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.777820 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.778046 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.778139 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.778358 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.778451 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.778661 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.778748 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.778966 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.779067 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.779273 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.779366 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.779582 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.779675 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.779911 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.780000 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.780236 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.780343 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.780565 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.780651 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.780871 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.780966 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.781204 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.781297 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.781509 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.781644 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.781815 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.781902 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.782122 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.782207 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.782427 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.782511 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.782730 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.782823 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.783041 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.783127 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.783353 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.783485 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.783658 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.783744 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.784002 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.784099 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.784311 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.784409 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.784618 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.784712 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.784928 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.785012 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.785231 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.785329 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.785537 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.785629 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.785847 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.785938 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.786155 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.786253 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.786464 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.786557 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.786776 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.786862 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.787081 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.787203 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.787400 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.787503 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.787733 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.787856 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.788064 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.788159 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.788385 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.788471 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.788703 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.788789 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.789006 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.789092 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.789319 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.789405 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.789632 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.789718 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.789945 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.790033 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.790246 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.790332 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.790810 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.790912 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.791120 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.791215 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.791424 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.791516 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.791726 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.791889 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.792057 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.792143 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.792359 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.792455 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.792663 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.792760 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.792966 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.793061 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.793269 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.793354 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.793572 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.793671 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.793893 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.793985 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.794200 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.794293 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.794503 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.794589 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.794805 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.794891 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.795106 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.795193 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.795418 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.795512 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.795726 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.795877 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.796068 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.796169 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.796396 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.796483 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.796709 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.796796 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.797017 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.797114 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.797325 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.797411 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.797633 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.797718 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.797944 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.798037 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.798254 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.798340 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.798566 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.798651 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.798876 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.798971 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.799194 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.799279 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.799504 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.799590 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.799845 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.799949 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.800157 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.800250 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.800479 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.800565 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.800789 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.800887 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.801102 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.801189 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.801404 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.801496 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.801720 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.801859 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.802033 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.802119 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.802357 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.802443 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.802670 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.802764 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.802989 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.803074 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.803330 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.803647 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.803739 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.803981 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.804079 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.804292 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.804379 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.804613 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.804715 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.804908 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.804994 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.805225 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.805316 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.805533 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.805629 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.805848 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.805933 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.806154 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.806240 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.806474 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.806562 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.806782 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.806868 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.807093 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.807185 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.807394 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.807481 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.807705 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.807839 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.808051 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.808137 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.808364 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.808452 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.808680 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.808765 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.808990 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.809075 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.809311 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.809397 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.809621 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.809707 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.809927 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.810013 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.810235 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.810321 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.810536 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.810628 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.810841 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.810936 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.811150 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.811243 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.811464 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.811550 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.811791 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.811932 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.812105 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.812191 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.812409 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.812559 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.812722 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.812972 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.813067 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.813296 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.813382 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.813608 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.813703 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.813916 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.814002 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.814229 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.814313 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.814535 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.814636 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.814850 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.814935 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.815166 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.815252 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.815467 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.815562 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.815798 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.815921 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.816119 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.816214 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.816426 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.816535 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.816729 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.816820 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.817074 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.817411 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.817713 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.817812 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.818037 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.818359 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.818667 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.819500 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.819845 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.820162 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.820468 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.820801 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.821057 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.821189 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.821439 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.821532 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.821781 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.821921 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.822114 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.822204 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.822440 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.822526 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.822765 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.822852 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.823079 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.823165 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.823396 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.823490 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.823711 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.823832 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.824048 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.824153 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.824371 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.824458 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.824689 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.824775 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.825003 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.825101 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.825318 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.825404 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.825633 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.825720 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.825946 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.826041 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.826262 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.826349 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.826584 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.826677 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.826898 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.826991 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.827209 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.827293 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.827529 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.827662 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.827848 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.827937 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.828161 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.828248 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.828480 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.828565 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.829053 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.829208 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.829388 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.829484 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.829707 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.829799 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.830031 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.830125 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.830380 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.830480 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.830701 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.830798 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.831035 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.831120 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.831364 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.831462 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.831680 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.831811 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.832016 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.832139 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.832331 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.832418 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.832682 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.832806 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.832945 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.833039 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.833257 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.833343 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.833565 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.833652 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.833869 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.834004 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.834175 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.834262 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.835038 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.835132 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.835346 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.835446 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.835654 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.835740 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.835985 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.836079 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.836290 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.836383 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.836608 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.836693 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.836912 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.836998 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.837225 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.837323 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.837530 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.837615 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.837852 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.837940 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.838161 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.838255 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.838466 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.838551 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.838768 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.838854 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.839075 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.839169 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.839420 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.839513 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.839725 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.839831 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.840087 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.840175 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.840416 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.840507 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.840757 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.840843 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.841065 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.841159 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.841370 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.841464 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.841694 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.841787 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.841998 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.842083 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.842302 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.842395 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.842602 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.842696 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.842912 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.843004 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.843217 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.843303 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.843519 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.843613 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.843850 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.843940 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.844161 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.844248 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.844469 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.844568 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.844778 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.844862 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.845079 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.845165 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.845384 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.845522 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.845687 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.845784 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.845999 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.846085 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.846308 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.846405 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.846609 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.846703 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.846908 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.846993 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.847218 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.847312 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.847522 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.847607 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.847845 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.847932 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.848155 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.848241 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.848457 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.848543 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.848768 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.848854 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.849071 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.849157 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.849371 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.849456 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.849672 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.849766 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.850006 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.850101 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.850314 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.850401 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.850615 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.850718 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.850941 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.851030 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.851251 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.851340 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.851553 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.851648 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.851880 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.851984 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.852193 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.852279 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.852495 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.852590 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.852798 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.852884 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.853104 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.853190 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.853426 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.853513 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.853737 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.853829 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.854038 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.854126 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.854346 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.854440 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.854651 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.854739 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.854954 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.855040 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.855256 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.855342 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.855564 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.855769 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.855898 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.856088 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.856213 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.856396 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.856519 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.856703 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.856825 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.857010 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.857131 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.857313 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.857454 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.857653 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.857767 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.858074 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.858217 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.858425 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.858731 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.858824 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.859076 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.859291 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.859378 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.859729 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.859884 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.860064 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.860383 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.860524 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.860708 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.861024 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.861112 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.861339 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.861659 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.861745 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.861968 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.862266 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.862359 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.862645 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.862868 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.863216 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.863373 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.863705 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.863823 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.864060 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.864373 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.864465 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.864693 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.864973 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.865062 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.865335 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.865463 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.865723 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.865818 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.865984 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.866070 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.866297 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.866388 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.866622 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.866712 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.866940 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.867031 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.867256 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.867347 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.867576 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.867665 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.867924 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.868075 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.868236 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.868331 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.868542 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.868725 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.868857 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.869169 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.869324 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.869482 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.869794 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.869887 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.870106 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.870420 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.870519 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.870739 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.871056 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.871143 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.871367 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.871647 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.871735 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.871999 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.872098 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.872312 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.872399 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.872621 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.872709 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.872924 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.873011 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.873248 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.873341 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.873556 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.873644 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.873859 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.873946 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.874168 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.874265 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.874473 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.874571 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.874779 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.874867 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.875083 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.875186 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.875512 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.875608 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.875844 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.875936 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.876158 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.876255 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.876462 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.876550 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.876770 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.876857 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.877081 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.877176 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.877397 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.877484 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.877713 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.877808 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.878018 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.878184 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.878431 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.878519 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.878741 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.878829 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.879050 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.879147 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.879363 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.879457 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.879668 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.879783 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.879996 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.880085 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.880309 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.880432 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.880634 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.880727 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.880935 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.881022 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.881760 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.881855 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.882065 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.882151 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.882385 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.882472 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.882690 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.882830 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.883012 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.883107 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.883425 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.883520 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.883736 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.883844 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.884063 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.884163 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.884483 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.884586 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.884794 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.884893 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.885105 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.885229 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.885428 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.885533 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.885745 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.885846 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.886070 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.886171 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.886376 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.886484 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.886689 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.886790 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.886999 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.887093 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.887321 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.887424 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.887639 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.887734 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.887974 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.888067 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.888287 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.888395 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.888593 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.888697 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.888910 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.889004 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.889229 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.889327 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.889542 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.889636 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.889861 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.889959 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.890270 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.890373 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.890593 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.890689 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.890907 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.891009 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.891226 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.891326 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.891552 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.891645 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.891879 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.891986 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.892185 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.892279 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.892494 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.892590 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.892872 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.892982 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.893104 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.893197 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.893426 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.893520 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.893731 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.893834 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.894044 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.894144 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.894351 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.894449 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.894661 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.894755 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.894964 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.895057 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.895269 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.895362 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.895588 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.895682 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.895918 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.896012 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.896239 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.896338 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.896551 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.896648 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.896924 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.897538 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.897755 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.897849 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.898062 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.898156 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.898379 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.898473 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.898690 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.898783 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.898989 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.899082 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.899293 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.899388 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.899596 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.899698 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.899966 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.900061 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.900272 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.900367 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.900594 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.900696 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.900922 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.901023 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.901249 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.901345 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.901558 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.901661 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.901892 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.901986 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.902218 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.902311 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.902539 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.902634 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.902852 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.902961 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.903173 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.903271 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.903499 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.903595 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.903824 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.903920 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.904130 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.904223 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.904439 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.904539 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.904740 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.904835 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.905045 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.905140 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.905340 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.905428 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.905638 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.905723 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.905937 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.906037 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.906243 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.906355 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.906544 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.906631 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.906865 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.906964 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.907166 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.907253 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.907485 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.907579 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.907822 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.907931 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.908128 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.908216 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.908434 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.908520 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.908735 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.908835 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.909078 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.909175 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.909383 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.909478 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.909714 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.909801 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.910021 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.910107 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.910343 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.910430 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.910662 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.910750 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.910994 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.911089 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.911294 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.911382 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.911611 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.911698 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.911952 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.912047 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.912269 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.912355 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.912609 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.912706 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.912925 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.913032 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.913294 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.913398 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.913555 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.913655 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.913870 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.913956 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.914426 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.914525 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.914756 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.914919 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.915073 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.915168 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.915387 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.915483 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.915992 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.916083 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.916307 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.916525 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.916616 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.916705 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.916917 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.917014 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.917228 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.917316 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.917539 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.917627 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.917848 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.917934 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.918175 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.918262 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.918496 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.918584 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.918818 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.918904 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.919149 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.919236 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.919468 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.919557 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.919800 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.919891 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.920117 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.920216 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.920433 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.920519 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.920789 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.920879 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.921103 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.921197 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.921408 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.921495 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.921722 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.921817 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.922037 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.922132 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.922351 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.922438 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.922661 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.922748 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.922968 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.923124 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.923279 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.923366 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.923588 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.923674 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.923920 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.924010 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.924230 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.924317 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.924541 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.924637 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.924854 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.924979 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.925176 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.925269 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.925507 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.925601 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.925824 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.925919 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.926134 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.926223 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.926446 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.926575 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.926757 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.926850 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.927276 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.927363 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.927591 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.927679 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.927948 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.928038 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.928298 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.928386 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.928624 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.928711 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.928937 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.929023 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.929255 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.929341 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.929580 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.929667 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.929884 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.929971 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.930189 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.930283 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.930498 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.930584 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.930810 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.930896 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.931113 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.931209 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.931435 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.931521 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.931746 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.931851 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.932075 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.932177 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.932393 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.932479 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.932702 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.932789 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.933234 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.933329 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.933581 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.933668 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.933896 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.933981 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.934218 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.934305 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.934542 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.934634 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.934856 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.934949 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.935163 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.935250 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.935481 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.935566 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.935808 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.935899 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.936116 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.936213 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.936441 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.936536 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.936754 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.936848 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.937055 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.937150 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.937357 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.937444 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.937665 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.937759 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.937973 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.938068 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.938273 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.938361 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.938581 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.938676 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.938879 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.938972 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.939203 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.939290 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.939506 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.939601 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.939830 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.939918 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.940140 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.940229 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.940449 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.940551 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.940753 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.940842 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.941054 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.941140 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.941356 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.941444 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.941659 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.941746 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.941968 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.942066 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.942268 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.942354 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.942576 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.942673 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.942877 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.942963 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.943185 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.943312 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.943533 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.943620 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.944383 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.944474 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.944688 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.944776 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.945009 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.945097 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.945331 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.945428 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.945617 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.945702 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.945931 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.946016 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.946241 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.946338 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.946561 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.946655 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.946874 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.946962 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.947181 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.947277 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.947525 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.947613 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.947863 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.947955 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.948397 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.948497 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.948731 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.948817 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.949052 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.949138 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.949382 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.949471 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.949711 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.949803 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.950017 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.950103 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.950319 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.950406 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.950622 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.950708 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.950943 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.951029 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.951254 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.951341 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.951563 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.951656 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.951896 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.951987 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.952207 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.952304 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.952516 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.952603 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.952824 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.952923 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.953134 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.953228 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.953440 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.953533 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.953748 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.953860 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.954055 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.954141 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.954362 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.954457 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.954668 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.954764 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.954977 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.955070 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.955284 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.955371 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.955595 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.955684 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.955960 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.956063 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.956277 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.956366 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.956595 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.956683 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.956907 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.956993 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.957223 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.957310 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.957534 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.957628 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.957841 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.957934 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.958152 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.958247 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.958457 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.958544 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.958771 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.958856 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.959094 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.959190 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.959977 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.960075 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.960290 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.960380 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.960987 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.961084 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.961305 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.961393 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.961627 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.961716 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.961950 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.962039 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.962262 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.962347 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.962584 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.962678 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.962908 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.962996 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.963217 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.963303 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.963538 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.963707 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.963872 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.963969 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.964211 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.964296 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.964548 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.964647 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.964876 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.964962 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.965197 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.965283 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.965502 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.965597 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.965806 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.965893 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.966106 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.966191 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.966415 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.966511 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.966730 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.966817 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.967041 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.967132 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.967343 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.967432 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.967644 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.967739 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.967976 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.968062 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.968278 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.968366 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.968578 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.968664 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.968880 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.968975 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.969180 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.969274 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.969486 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.969574 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.969785 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.969877 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.970084 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.970171 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.970385 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.970470 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.970688 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.970775 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.970988 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.971075 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.971288 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.971374 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.971592 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.971688 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.971916 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.972015 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.972220 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.972305 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.972520 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.972614 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.972820 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.972906 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.973119 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.973206 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.973445 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.973542 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.973774 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.973862 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.974087 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.974182 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.974408 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.974495 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.974713 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.974799 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.975056 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.975145 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.975365 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.975449 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.975682 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.975798 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.976026 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.976122 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.976339 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.976426 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.976643 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.976736 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.976973 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.977060 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.977279 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.977367 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.977586 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.977679 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.977891 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.977986 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.978198 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.978286 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.978505 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.978598 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.978812 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.978977 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.979132 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.979218 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.979457 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.979543 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.979774 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.979875 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.980102 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.980190 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.980448 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.980544 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.980732 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.980828 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.981045 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.981130 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.981351 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.981437 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.981682 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.981800 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.981989 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.982091 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.982297 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.982384 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.982602 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.982690 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.982909 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.983003 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.983217 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.983315 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.983527 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.983621 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.983860 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.983952 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.984171 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.984268 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.984483 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.984571 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.984798 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.984885 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.985120 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.985215 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.985442 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.985529 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.985752 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.985840 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.986076 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.986171 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.986411 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.986497 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.986759 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.986847 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.987070 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.987158 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.987410 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.987497 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.987737 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.987870 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.988071 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.988159 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.988383 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.988469 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.988685 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.988770 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:03:18.988929 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 01:03:18.989019 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 01:03:19.141510 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO dbcounter [None req-5b96b230-06b6-4334-a41d-471b211f2fb3 None None] Registered counter for database nova_api Sep 06 01:03:19.141710 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: INFO dbcounter [None req-99bd97f6-7c62-4b15-b348-276f19602117 None None] Registered counter for database nova_api Sep 06 01:03:19.162524 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG oslo_db.sqlalchemy.engines [None req-99bd97f6-7c62-4b15-b348-276f19602117 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105588) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 01:03:19.164275 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG oslo_db.sqlalchemy.engines [None req-5b96b230-06b6-4334-a41d-471b211f2fb3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105587) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 01:03:19.169429 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG dbcounter [-] [105588] Writer thread running {{(pid=105588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 01:03:19.170904 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG dbcounter [-] [105587] Writer thread running {{(pid=105587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 01:03:19.226962 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.context [None req-99bd97f6-7c62-4b15-b348-276f19602117 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),aad59874-72ec-4cb0-bd6c-f8599f20aa58(cell1) {{(pid=105588) load_cells /opt/stack/nova/nova/context.py:464}} Sep 06 01:03:19.227998 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.context [None req-5b96b230-06b6-4334-a41d-471b211f2fb3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),aad59874-72ec-4cb0-bd6c-f8599f20aa58(cell1) {{(pid=105587) load_cells /opt/stack/nova/nova/context.py:464}} Sep 06 01:03:19.231015 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG oslo_concurrency.lockutils [None req-99bd97f6-7c62-4b15-b348-276f19602117 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:03:19.231502 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG oslo_concurrency.lockutils [None req-99bd97f6-7c62-4b15-b348-276f19602117 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:03:19.232075 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG oslo_concurrency.lockutils [None req-5b96b230-06b6-4334-a41d-471b211f2fb3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:03:19.232558 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG oslo_concurrency.lockutils [None req-5b96b230-06b6-4334-a41d-471b211f2fb3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:03:19.233092 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG oslo_concurrency.lockutils [None req-99bd97f6-7c62-4b15-b348-276f19602117 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:03:19.233837 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG oslo_concurrency.lockutils [None req-99bd97f6-7c62-4b15-b348-276f19602117 None None] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:03:19.234117 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG oslo_concurrency.lockutils [None req-5b96b230-06b6-4334-a41d-471b211f2fb3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:03:19.234284 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG oslo_concurrency.lockutils [None req-99bd97f6-7c62-4b15-b348-276f19602117 None None] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:03:19.234847 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG oslo_concurrency.lockutils [None req-5b96b230-06b6-4334-a41d-471b211f2fb3 None None] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:03:19.235287 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG oslo_concurrency.lockutils [None req-5b96b230-06b6-4334-a41d-471b211f2fb3 None None] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:03:19.236285 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG oslo_concurrency.lockutils [None req-99bd97f6-7c62-4b15-b348-276f19602117 None None] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:03:19.237291 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG oslo_concurrency.lockutils [None req-5b96b230-06b6-4334-a41d-471b211f2fb3 None None] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:03:19.238276 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: INFO dbcounter [None req-99bd97f6-7c62-4b15-b348-276f19602117 None None] Registered counter for database nova_cell0 Sep 06 01:03:19.239270 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO dbcounter [None req-5b96b230-06b6-4334-a41d-471b211f2fb3 None None] Registered counter for database nova_cell0 Sep 06 01:03:19.242820 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: INFO dbcounter [None req-99bd97f6-7c62-4b15-b348-276f19602117 None None] Registered counter for database nova_cell1 Sep 06 01:03:19.243941 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO dbcounter [None req-5b96b230-06b6-4334-a41d-471b211f2fb3 None None] Registered counter for database nova_cell1 Sep 06 01:03:19.250015 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG oslo_db.sqlalchemy.engines [None req-99bd97f6-7c62-4b15-b348-276f19602117 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105588) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 01:03:19.251659 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG oslo_db.sqlalchemy.engines [None req-99bd97f6-7c62-4b15-b348-276f19602117 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105588) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 01:03:19.253331 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG oslo_db.sqlalchemy.engines [None req-5b96b230-06b6-4334-a41d-471b211f2fb3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105587) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 01:03:19.257067 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG oslo_db.sqlalchemy.engines [None req-5b96b230-06b6-4334-a41d-471b211f2fb3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105587) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 01:03:19.257431 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG dbcounter [-] [105588] Writer thread running {{(pid=105588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 01:03:19.260866 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG dbcounter [-] [105587] Writer thread running {{(pid=105587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 01:03:19.394290 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG dbcounter [-] [105588] Writer thread running {{(pid=105588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 01:03:19.398371 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG dbcounter [-] [105587] Writer thread running {{(pid=105587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 01:03:19.404543 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: INFO dbcounter [None req-99bd97f6-7c62-4b15-b348-276f19602117 None None] Registered counter for database nova_cell0 Sep 06 01:03:19.408062 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO dbcounter [None req-5b96b230-06b6-4334-a41d-471b211f2fb3 None None] Registered counter for database nova_cell0 Sep 06 01:03:19.411262 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG oslo_db.sqlalchemy.engines [None req-99bd97f6-7c62-4b15-b348-276f19602117 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105588) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 01:03:19.416777 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG dbcounter [-] [105588] Writer thread running {{(pid=105588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 01:03:19.417356 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG oslo_db.sqlalchemy.engines [None req-5b96b230-06b6-4334-a41d-471b211f2fb3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105587) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 01:03:19.421912 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG dbcounter [-] [105587] Writer thread running {{(pid=105587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 01:03:19.752132 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: WARNING keystonemiddleware.auth_token [None req-5b96b230-06b6-4334-a41d-471b211f2fb3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 01:03:19.755488 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: WARNING keystonemiddleware.auth_token [None req-99bd97f6-7c62-4b15-b348-276f19602117 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 01:03:19.759395 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: WARNING keystonemiddleware.auth_token [None req-5b96b230-06b6-4334-a41d-471b211f2fb3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 01:03:19.762679 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: WARNING keystonemiddleware.auth_token [None req-99bd97f6-7c62-4b15-b348-276f19602117 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 01:03:20.096776 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: WARNING keystonemiddleware.auth_token [None req-5b96b230-06b6-4334-a41d-471b211f2fb3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 01:03:20.103240 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: WARNING keystonemiddleware.auth_token [None req-5b96b230-06b6-4334-a41d-471b211f2fb3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 01:03:20.107071 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: WARNING keystonemiddleware.auth_token [None req-99bd97f6-7c62-4b15-b348-276f19602117 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 01:03:20.108530 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56313e6d39c0 pid: 105587 (default app) Sep 06 01:03:20.110566 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-5b96b230-06b6-4334-a41d-471b211f2fb3 None None] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:03:20.111796 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-5b96b230-06b6-4334-a41d-471b211f2fb3 None None] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001743 Sep 06 01:03:20.112207 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 788 bytes} [Tue Sep 6 01:03:20 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:03:20.112998 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: WARNING keystonemiddleware.auth_token [None req-99bd97f6-7c62-4b15-b348-276f19602117 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 01:03:20.118300 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56313e6d39c0 pid: 105588 (default app) Sep 06 01:04:37.753028 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-5b96b230-06b6-4334-a41d-471b211f2fb3 None None] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:04:37.754810 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-5b96b230-06b6-4334-a41d-471b211f2fb3 None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002429 Sep 06 01:04:37.755284 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 2/2] 10.222.0.23 () {54 vars in 931 bytes} [Tue Sep 6 01:04:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:04:37.772246 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG dbcounter [-] [105588] Writing DB stats nova_api:SELECT=3 {{(pid=105588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:04:37.773024 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG dbcounter [-] [105588] Writing DB stats nova_cell1:SELECT=3 {{(pid=105588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:04:37.774042 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG dbcounter [-] [105588] Writing DB stats nova_cell0:SELECT=3 {{(pid=105588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:04:37.774759 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG dbcounter [-] [105588] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:04:38.621251 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-21a065e5-b563-47ad-9636-48406d2e1a05 admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:04:38.654194 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-21a065e5-b563-47ad-9636-48406d2e1a05 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.891914 Sep 06 01:04:38.654946 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 1/3] 10.222.0.23 () {60 vars in 1292 bytes} [Tue Sep 6 01:04:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:04:41.051082 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-5b96b230-06b6-4334-a41d-471b211f2fb3 None None] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:04:41.052109 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-5b96b230-06b6-4334-a41d-471b211f2fb3 None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Sep 06 01:04:41.052673 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 3/4] 10.222.0.23 () {54 vars in 931 bytes} [Tue Sep 6 01:04:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:04:41.494601 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-86250fd7-9826-4857-979f-407dfee80cef admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "disk": 1, "os-flavor-access:is_public": true, "ram": 256, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "id": "c1"}} {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:04:41.548522 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-86250fd7-9826-4857-979f-407dfee80cef admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.489537 Sep 06 01:04:41.549157 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 2/5] 10.222.0.23 () {64 vars in 1283 bytes} [Tue Sep 6 01:04:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 01:04:41.778695 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-ee678f5f-0ab0-4b4d-973d-b69640106705 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:04:41.785204 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG dbcounter [-] [105587] Writing DB stats nova_api:SELECT=3 {{(pid=105587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:04:41.786003 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG dbcounter [-] [105587] Writing DB stats nova_cell0:SELECT=3 {{(pid=105587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:04:41.786883 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG dbcounter [-] [105587] Writing DB stats nova_cell1:SELECT=3 {{(pid=105587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:04:41.787651 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG dbcounter [-] [105587] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:04:41.845257 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-ee678f5f-0ab0-4b4d-973d-b69640106705 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.287261 Sep 06 01:04:41.846084 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 4/6] 10.222.0.23 () {64 vars in 1336 bytes} [Tue Sep 6 01:04:41 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:04:44.277199 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-86250fd7-9826-4857-979f-407dfee80cef admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:04:44.278803 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-86250fd7-9826-4857-979f-407dfee80cef admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002051 Sep 06 01:04:44.279362 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 3/7] 10.222.0.23 () {54 vars in 931 bytes} [Tue Sep 6 01:04:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:04:44.932992 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-48cc3982-e8df-4fa0-96ea-1483690ddb6c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds512M", "os-flavor-access:is_public": true, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "rxtx_factor": 1.0, "ram": 512, "vcpus": 1}} {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:04:44.972341 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-48cc3982-e8df-4fa0-96ea-1483690ddb6c admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.686562 Sep 06 01:04:44.972816 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 5/8] 10.222.0.23 () {64 vars in 1283 bytes} [Tue Sep 6 01:04:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 01:04:44.985261 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-fc66ba96-c3ba-493e-aef8-7516ac0d0f48 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:04:45.025206 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-fc66ba96-c3ba-493e-aef8-7516ac0d0f48 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042705 Sep 06 01:04:45.031780 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 4/9] 10.222.0.23 () {64 vars in 1336 bytes} [Tue Sep 6 01:04:44 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:04:47.367732 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-48cc3982-e8df-4fa0-96ea-1483690ddb6c admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:04:47.368780 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-48cc3982-e8df-4fa0-96ea-1483690ddb6c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Sep 06 01:04:47.369208 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 6/10] 10.222.0.23 () {54 vars in 931 bytes} [Tue Sep 6 01:04:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:04:47.771679 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-e34fbd3f-0c2c-41d7-bd36-af2cd36aa22b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds1G", "disk": 10, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "vcpus": 1, "rxtx_factor": 1.0, "id": "d2"}} {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:04:47.790162 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-e34fbd3f-0c2c-41d7-bd36-af2cd36aa22b admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.414626 Sep 06 01:04:47.790628 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 5/11] 10.222.0.23 () {64 vars in 1283 bytes} [Tue Sep 6 01:04:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 01:04:47.803009 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-7de23aa6-6094-4741-b4f8-35aba49c319f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:04:47.826521 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-7de23aa6-6094-4741-b4f8-35aba49c319f admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027635 Sep 06 01:04:47.827068 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 7/12] 10.222.0.23 () {64 vars in 1336 bytes} [Tue Sep 6 01:04:47 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:04:50.169640 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-e34fbd3f-0c2c-41d7-bd36-af2cd36aa22b admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:04:50.170651 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-e34fbd3f-0c2c-41d7-bd36-af2cd36aa22b admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Sep 06 01:04:50.171064 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 6/13] 10.222.0.23 () {54 vars in 931 bytes} [Tue Sep 6 01:04:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:04:50.616370 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-ba1b31e5-0ddb-46df-b40d-2097573df3e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 2, "swap": 0, "id": "d3", "disk": 10, "ram": 2048, "name": "ds2G", "os-flavor-access:is_public": true}} {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:04:50.636714 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-ba1b31e5-0ddb-46df-b40d-2097573df3e8 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.458343 Sep 06 01:04:50.637437 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 8/14] 10.222.0.23 () {64 vars in 1283 bytes} [Tue Sep 6 01:04:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 01:04:50.649893 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-3d4228ea-62ee-4df7-9e0d-2f01eb89e941 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:04:50.674847 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-3d4228ea-62ee-4df7-9e0d-2f01eb89e941 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028477 Sep 06 01:04:50.675459 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 7/15] 10.222.0.23 () {64 vars in 1336 bytes} [Tue Sep 6 01:04:50 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:04:53.049643 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-ba1b31e5-0ddb-46df-b40d-2097573df3e8 admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:04:53.050583 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-ba1b31e5-0ddb-46df-b40d-2097573df3e8 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Sep 06 01:04:53.051191 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 9/16] 10.222.0.23 () {54 vars in 931 bytes} [Tue Sep 6 01:04:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:04:53.479826 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-f32860ad-6cce-440a-8cb4-8b8523b79f45 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "disk": 20, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds4G", "vcpus": 4, "id": "d4", "swap": 0}} {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:04:53.499233 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-f32860ad-6cce-440a-8cb4-8b8523b79f45 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.440889 Sep 06 01:04:53.500110 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 8/17] 10.222.0.23 () {64 vars in 1283 bytes} [Tue Sep 6 01:04:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 01:04:53.512520 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-53b0fe91-396e-4aec-a55b-75835dfc00e6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:04:53.542899 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-53b0fe91-396e-4aec-a55b-75835dfc00e6 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033998 Sep 06 01:04:53.543568 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 10/18] 10.222.0.23 () {64 vars in 1336 bytes} [Tue Sep 6 01:04:53 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:04:55.922707 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-f32860ad-6cce-440a-8cb4-8b8523b79f45 admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:04:55.924255 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-f32860ad-6cce-440a-8cb4-8b8523b79f45 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002019 Sep 06 01:04:55.924661 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 9/19] 10.222.0.23 () {54 vars in 931 bytes} [Tue Sep 6 01:04:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:04:56.375844 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-c67591de-cd44-48bd-a5c5-91b6254d4a6b admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:04:56.399491 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-c67591de-cd44-48bd-a5c5-91b6254d4a6b admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.468791 Sep 06 01:04:56.400086 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 11/20] 10.222.0.23 () {60 vars in 1292 bytes} [Tue Sep 6 01:04:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:04:58.740661 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-f32860ad-6cce-440a-8cb4-8b8523b79f45 admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:04:58.741627 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-f32860ad-6cce-440a-8cb4-8b8523b79f45 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Sep 06 01:04:58.742030 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 10/21] 10.222.0.23 () {54 vars in 931 bytes} [Tue Sep 6 01:04:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:04:59.140416 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-917dc1af-3630-489f-938a-727a47ecc8ce admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "disk": 1, "swap": 0, "ram": 512, "id": "1", "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:04:59.160628 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-917dc1af-3630-489f-938a-727a47ecc8ce admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.412657 Sep 06 01:04:59.161430 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 12/22] 10.222.0.23 () {64 vars in 1283 bytes} [Tue Sep 6 01:04:58 2022] POST /compute/v2.1/flavors => generated 402 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 01:04:59.176191 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-8e562772-ec0b-4d98-8d4d-9d9f27f58c66 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:04:59.199683 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-8e562772-ec0b-4d98-8d4d-9d9f27f58c66 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027137 Sep 06 01:04:59.200286 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 11/23] 10.222.0.23 () {64 vars in 1333 bytes} [Tue Sep 6 01:04:59 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:05:01.550284 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-917dc1af-3630-489f-938a-727a47ecc8ce admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:05:01.551300 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-917dc1af-3630-489f-938a-727a47ecc8ce admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Sep 06 01:05:01.551714 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 13/24] 10.222.0.23 () {54 vars in 931 bytes} [Tue Sep 6 01:05:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:05:01.961279 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-14e63f4f-a458-491f-b16f-d6f7f32eb7ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 2048, "disk": 20, "rxtx_factor": 1.0, "name": "m1.small", "id": "2", "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:05:01.979786 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-14e63f4f-a458-491f-b16f-d6f7f32eb7ef admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.421867 Sep 06 01:05:01.980356 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 12/25] 10.222.0.23 () {64 vars in 1283 bytes} [Tue Sep 6 01:05:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 01:05:01.992100 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-b186cdbc-5c27-4d13-b4cf-58b10b1b285a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:05:02.017460 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-b186cdbc-5c27-4d13-b4cf-58b10b1b285a admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028367 Sep 06 01:05:02.018479 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 14/26] 10.222.0.23 () {64 vars in 1333 bytes} [Tue Sep 6 01:05:01 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:05:04.353472 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-14e63f4f-a458-491f-b16f-d6f7f32eb7ef admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:05:04.354404 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-14e63f4f-a458-491f-b16f-d6f7f32eb7ef admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Sep 06 01:05:04.354815 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 13/27] 10.222.0.23 () {54 vars in 931 bytes} [Tue Sep 6 01:05:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:05:04.765819 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-0e1177c0-e9d1-478f-a49c-390e8bfaa275 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "m1.medium", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "swap": 0, "id": "3", "rxtx_factor": 1.0, "disk": 40}} {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:05:04.788020 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-0e1177c0-e9d1-478f-a49c-390e8bfaa275 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.427137 Sep 06 01:05:04.789435 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 15/28] 10.222.0.23 () {64 vars in 1283 bytes} [Tue Sep 6 01:05:04 2022] POST /compute/v2.1/flavors => generated 406 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 01:05:04.801103 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-c4c10637-4edc-4a5f-97db-3c3c58ad65dd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:05:04.827370 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-c4c10637-4edc-4a5f-97db-3c3c58ad65dd admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029819 Sep 06 01:05:04.828232 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 14/29] 10.222.0.23 () {64 vars in 1333 bytes} [Tue Sep 6 01:05:04 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:05:07.247317 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-0e1177c0-e9d1-478f-a49c-390e8bfaa275 admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:05:07.249059 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-0e1177c0-e9d1-478f-a49c-390e8bfaa275 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002156 Sep 06 01:05:07.249464 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 16/30] 10.222.0.23 () {54 vars in 931 bytes} [Tue Sep 6 01:05:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:05:07.705695 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-82235dbc-3698-49f0-a20c-96d963495bc9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "ram": 8192, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "name": "m1.large", "id": "4"}} {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:05:07.741994 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-82235dbc-3698-49f0-a20c-96d963495bc9 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.485044 Sep 06 01:05:07.742731 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 15/31] 10.222.0.23 () {64 vars in 1283 bytes} [Tue Sep 6 01:05:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 01:05:07.754601 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-952de7c9-488d-42c2-ac5c-c911d16ea5a6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:05:07.781753 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-952de7c9-488d-42c2-ac5c-c911d16ea5a6 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030780 Sep 06 01:05:07.783074 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 17/32] 10.222.0.23 () {64 vars in 1333 bytes} [Tue Sep 6 01:05:07 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:05:10.150251 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-82235dbc-3698-49f0-a20c-96d963495bc9 admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:05:10.151872 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-82235dbc-3698-49f0-a20c-96d963495bc9 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002095 Sep 06 01:05:10.156068 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 16/33] 10.222.0.23 () {54 vars in 931 bytes} [Tue Sep 6 01:05:10 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:05:10.638043 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-2c0ceddb-8a12-4c73-9787-67940ecccddb admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 16384, "id": "5", "name": "m1.xlarge", "disk": 160, "vcpus": 8, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:05:10.676437 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-2c0ceddb-8a12-4c73-9787-67940ecccddb admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.517000 Sep 06 01:05:10.677592 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 18/34] 10.222.0.23 () {64 vars in 1283 bytes} [Tue Sep 6 01:05:10 2022] POST /compute/v2.1/flavors => generated 408 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 01:05:10.691662 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-cb183e9b-d142-4bd1-ada0-69a1f0e2115f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:05:10.706036 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG dbcounter [-] [105588] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:05:10.727566 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-cb183e9b-d142-4bd1-ada0-69a1f0e2115f admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040199 Sep 06 01:05:10.728464 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 17/35] 10.222.0.23 () {64 vars in 1333 bytes} [Tue Sep 6 01:05:10 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:05:29.452058 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-2c0ceddb-8a12-4c73-9787-67940ecccddb admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:05:29.454215 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-2c0ceddb-8a12-4c73-9787-67940ecccddb admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Sep 06 01:05:29.454215 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 19/36] 10.222.0.23 () {54 vars in 931 bytes} [Tue Sep 6 01:05:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:05:29.853532 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-9c69b651-bad0-4162-aec2-1df62814409c admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:05:29.873785 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-9c69b651-bad0-4162-aec2-1df62814409c admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.413731 Sep 06 01:05:29.874331 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 18/37] 10.222.0.23 () {60 vars in 1292 bytes} [Tue Sep 6 01:05:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:05:30.925945 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-2c0ceddb-8a12-4c73-9787-67940ecccddb admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:05:30.926943 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-2c0ceddb-8a12-4c73-9787-67940ecccddb admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Sep 06 01:05:30.927344 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 20/38] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Sep 6 01:05:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:05:31.446297 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-f2245d8c-9a32-4489-836a-8fa4682e94fa admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:05:31.451898 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.wsgi [None req-f2245d8c-9a32-4489-836a-8fa4682e94fa admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 06 01:05:31.455112 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-f2245d8c-9a32-4489-836a-8fa4682e94fa admin admin] Request method failure captured: Sep 06 01:05:31.455112 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 06 01:05:31.455112 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: Accept: application/json Sep 06 01:05:31.455112 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: Accept-Encoding: gzip, deflate Sep 06 01:05:31.455112 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: Connection: keep-alive Sep 06 01:05:31.455112 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: Content-Length: 0 Sep 06 01:05:31.455112 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: Host: 10.222.0.23 Sep 06 01:05:31.455112 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: Openstack-Api-Version: compute 2.92 Sep 06 01:05:31.455112 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: Openstack-System-Scope: None Sep 06 01:05:31.455112 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: User-Agent: python-novaclient Sep 06 01:05:31.455112 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Auth-Token: gAAAAABjFpzaTrqY3uIitflCveewprzKHr_-IccfdwURPJufSK3Sq3dXA1TzcmkLH8FlxjsV7NtNy2aFe28F1rYFtiSSlNVYn0Oyts-P-ZoMByUVoKcAf68JtYETmKH34NDICtB4JZzLxfQrgIlZTkPoD_Gfh6KW9-sn2aYFRjAJYL70pO9xjEo Sep 06 01:05:31.455112 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Domain-Id: None Sep 06 01:05:31.455112 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Domain-Name: None Sep 06 01:05:31.455112 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Identity-Status: Confirmed Sep 06 01:05:31.455112 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Is-Admin-Project: True Sep 06 01:05:31.455112 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 01:05:31.455112 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Project-Domain-Id: default Sep 06 01:05:31.455112 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Project-Domain-Name: Default Sep 06 01:05:31.455112 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Project-Id: 921fe46fc085463aa0816bc6ba906e3c Sep 06 01:05:31.455112 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Project-Name: admin Sep 06 01:05:31.455112 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Role: reader,member,admin Sep 06 01:05:31.455112 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Roles: reader,member,admin Sep 06 01:05:31.456859 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/921fe46fc085463aa0816bc6ba906e3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/921fe46fc085463aa0816bc6ba906e3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_921fe46fc085463aa0816bc6ba906e3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/921fe46fc085463aa0816bc6ba906e3c"}]}] Sep 06 01:05:31.456859 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Tenant: admin Sep 06 01:05:31.456859 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Tenant-Id: 921fe46fc085463aa0816bc6ba906e3c Sep 06 01:05:31.456859 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Tenant-Name: admin Sep 06 01:05:31.456859 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-User: admin Sep 06 01:05:31.456859 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-User-Domain-Id: default Sep 06 01:05:31.456859 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-User-Domain-Name: Default Sep 06 01:05:31.456859 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-User-Id: 1842912f886f4b17b51cd35bebba1a7e Sep 06 01:05:31.456859 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-User-Name: admin Sep 06 01:05:31.456859 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: method: > Sep 06 01:05:31.456859 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: exception: Flavor 42 could not be found. Sep 06 01:05:31.456859 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: action_args: {'id': '42'} Sep 06 01:05:31.456859 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:05:31.456859 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:05:31.457886 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 01:05:31.457886 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 01:05:31.457886 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 01:05:31.457886 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 01:05:31.457886 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 01:05:31.457886 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 01:05:31.457886 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 01:05:31.457886 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 01:05:31.457886 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 01:05:31.457886 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:05:31.457886 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 01:05:31.457886 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 01:05:31.457886 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 06 01:05:31.457886 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Sep 06 01:05:31.457886 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:05:31.457886 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Sep 06 01:05:31.457886 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:05:31.457886 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:05:31.457886 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:05:31.459241 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:05:31.459241 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:05:31.459241 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:05:31.459241 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:05:31.459241 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 01:05:31.459241 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:05:31.459241 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 06 01:05:31.459241 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Sep 06 01:05:31.459241 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:05:31.459241 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Sep 06 01:05:31.459241 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:05:31.459241 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:05:31.459241 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:05:31.459241 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:05:31.459241 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:05:31.459241 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 06 01:05:31.459241 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Sep 06 01:05:31.459241 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-f2245d8c-9a32-4489-836a-8fa4682e94fa admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:05:31.460586 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-f2245d8c-9a32-4489-836a-8fa4682e94fa admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.392579 Sep 06 01:05:31.460586 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 19/39] 10.222.0.23 () {60 vars in 1190 bytes} [Tue Sep 6 01:05:31 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 06 01:05:31.466217 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-51e2e453-a017-487d-9e0c-7e6e2df28e86 admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:05:31.470299 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG dbcounter [-] [105587] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:05:31.490016 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-51e2e453-a017-487d-9e0c-7e6e2df28e86 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027333 Sep 06 01:05:31.490544 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 21/40] 10.222.0.23 () {60 vars in 1210 bytes} [Tue Sep 6 01:05:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:05:31.500892 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-1f64f76d-1f92-4849-a470-6cf7a19610f5 admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:05:31.522862 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-1f64f76d-1f92-4849-a470-6cf7a19610f5 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026173 Sep 06 01:05:31.523383 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 20/41] 10.222.0.23 () {60 vars in 1210 bytes} [Tue Sep 6 01:05:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:05:31.533221 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-65e9f1c7-7ebf-4046-9053-4dc1ace4db01 admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:05:31.538868 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.wsgi [None req-65e9f1c7-7ebf-4046-9053-4dc1ace4db01 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 06 01:05:31.542341 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-65e9f1c7-7ebf-4046-9053-4dc1ace4db01 admin admin] Request method failure captured: Sep 06 01:05:31.542341 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 06 01:05:31.542341 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: Accept: application/json Sep 06 01:05:31.542341 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: Accept-Encoding: gzip, deflate Sep 06 01:05:31.542341 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: Connection: keep-alive Sep 06 01:05:31.542341 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: Content-Length: 0 Sep 06 01:05:31.542341 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: Host: 10.222.0.23 Sep 06 01:05:31.542341 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: Openstack-Api-Version: compute 2.92 Sep 06 01:05:31.542341 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: Openstack-System-Scope: None Sep 06 01:05:31.542341 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: User-Agent: python-novaclient Sep 06 01:05:31.542341 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Auth-Token: gAAAAABjFpzaTrqY3uIitflCveewprzKHr_-IccfdwURPJufSK3Sq3dXA1TzcmkLH8FlxjsV7NtNy2aFe28F1rYFtiSSlNVYn0Oyts-P-ZoMByUVoKcAf68JtYETmKH34NDICtB4JZzLxfQrgIlZTkPoD_Gfh6KW9-sn2aYFRjAJYL70pO9xjEo Sep 06 01:05:31.542341 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Domain-Id: None Sep 06 01:05:31.542341 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Domain-Name: None Sep 06 01:05:31.542341 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Identity-Status: Confirmed Sep 06 01:05:31.542341 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Is-Admin-Project: True Sep 06 01:05:31.542341 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 01:05:31.542341 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Project-Domain-Id: default Sep 06 01:05:31.542341 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Project-Domain-Name: Default Sep 06 01:05:31.542341 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Project-Id: 921fe46fc085463aa0816bc6ba906e3c Sep 06 01:05:31.542341 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Project-Name: admin Sep 06 01:05:31.542341 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Role: reader,member,admin Sep 06 01:05:31.542341 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Roles: reader,member,admin Sep 06 01:05:31.543901 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/921fe46fc085463aa0816bc6ba906e3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/921fe46fc085463aa0816bc6ba906e3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_921fe46fc085463aa0816bc6ba906e3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/921fe46fc085463aa0816bc6ba906e3c"}]}] Sep 06 01:05:31.543901 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Tenant: admin Sep 06 01:05:31.543901 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Tenant-Id: 921fe46fc085463aa0816bc6ba906e3c Sep 06 01:05:31.543901 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Tenant-Name: admin Sep 06 01:05:31.543901 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-User: admin Sep 06 01:05:31.543901 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-User-Domain-Id: default Sep 06 01:05:31.543901 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-User-Domain-Name: Default Sep 06 01:05:31.543901 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-User-Id: 1842912f886f4b17b51cd35bebba1a7e Sep 06 01:05:31.543901 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-User-Name: admin Sep 06 01:05:31.543901 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: method: > Sep 06 01:05:31.543901 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: exception: Flavor 42 could not be found. Sep 06 01:05:31.543901 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: action_args: {'id': '42'} Sep 06 01:05:31.543901 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:05:31.543901 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:05:31.544827 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 01:05:31.544827 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 01:05:31.544827 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 01:05:31.544827 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 01:05:31.544827 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 01:05:31.544827 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 01:05:31.544827 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 01:05:31.544827 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 01:05:31.544827 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 01:05:31.544827 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:05:31.544827 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 01:05:31.544827 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 01:05:31.544827 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 06 01:05:31.544827 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Sep 06 01:05:31.544827 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:05:31.544827 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Sep 06 01:05:31.544827 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:05:31.544827 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:05:31.544827 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:05:31.545955 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:05:31.545955 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:05:31.545955 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:05:31.545955 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:05:31.545955 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 01:05:31.545955 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:05:31.545955 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 06 01:05:31.545955 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Sep 06 01:05:31.545955 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:05:31.545955 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Sep 06 01:05:31.545955 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:05:31.545955 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:05:31.545955 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:05:31.545955 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:05:31.545955 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:05:31.545955 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 06 01:05:31.545955 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Sep 06 01:05:31.545955 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-65e9f1c7-7ebf-4046-9053-4dc1ace4db01 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:05:31.547485 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-65e9f1c7-7ebf-4046-9053-4dc1ace4db01 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014750 Sep 06 01:05:31.547485 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 22/42] 10.222.0.23 () {60 vars in 1190 bytes} [Tue Sep 6 01:05:31 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 06 01:05:32.501285 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-1f64f76d-1f92-4849-a470-6cf7a19610f5 admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:05:32.502299 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-1f64f76d-1f92-4849-a470-6cf7a19610f5 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Sep 06 01:05:32.502702 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 21/43] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Sep 6 01:05:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:05:33.023711 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-0e60e96f-0a7e-4e02-91a6-4ad4226f9ed2 admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:05:33.029448 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.wsgi [None req-0e60e96f-0a7e-4e02-91a6-4ad4226f9ed2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 06 01:05:33.030913 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-0e60e96f-0a7e-4e02-91a6-4ad4226f9ed2 admin admin] Request method failure captured: Sep 06 01:05:33.030913 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 06 01:05:33.030913 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: Accept: application/json Sep 06 01:05:33.030913 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: Accept-Encoding: gzip, deflate Sep 06 01:05:33.030913 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: Connection: keep-alive Sep 06 01:05:33.030913 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: Content-Length: 0 Sep 06 01:05:33.030913 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: Host: 10.222.0.23 Sep 06 01:05:33.030913 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: Openstack-Api-Version: compute 2.92 Sep 06 01:05:33.030913 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: Openstack-System-Scope: None Sep 06 01:05:33.030913 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: User-Agent: python-novaclient Sep 06 01:05:33.030913 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Auth-Token: gAAAAABjFpzc9f5bvew6aTmdfLX_9zJnH6Mw5i5Acqg8Ifyn6qzA73TB4UdLKuvYfJswTlyiib8aDFIsDky3EfvI7wzRvOUJHSukuezuP9bSkjjcL4rRWzR2kC_3USII5t3ckeg7t4-_Rpm05zRHFVKKgT6xlBwQyksZ-3-wVhAUXgJVDYRUP3k Sep 06 01:05:33.030913 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Domain-Id: None Sep 06 01:05:33.030913 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Domain-Name: None Sep 06 01:05:33.030913 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Identity-Status: Confirmed Sep 06 01:05:33.030913 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Is-Admin-Project: True Sep 06 01:05:33.030913 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 01:05:33.030913 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Project-Domain-Id: default Sep 06 01:05:33.030913 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Project-Domain-Name: Default Sep 06 01:05:33.030913 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Project-Id: 921fe46fc085463aa0816bc6ba906e3c Sep 06 01:05:33.030913 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Project-Name: admin Sep 06 01:05:33.030913 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Role: reader,member,admin Sep 06 01:05:33.030913 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Roles: reader,member,admin Sep 06 01:05:33.033004 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/921fe46fc085463aa0816bc6ba906e3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/921fe46fc085463aa0816bc6ba906e3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_921fe46fc085463aa0816bc6ba906e3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/921fe46fc085463aa0816bc6ba906e3c"}]}] Sep 06 01:05:33.033004 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Tenant: admin Sep 06 01:05:33.033004 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Tenant-Id: 921fe46fc085463aa0816bc6ba906e3c Sep 06 01:05:33.033004 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Tenant-Name: admin Sep 06 01:05:33.033004 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-User: admin Sep 06 01:05:33.033004 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-User-Domain-Id: default Sep 06 01:05:33.033004 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-User-Domain-Name: Default Sep 06 01:05:33.033004 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-User-Id: 1842912f886f4b17b51cd35bebba1a7e Sep 06 01:05:33.033004 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-User-Name: admin Sep 06 01:05:33.033004 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: method: > Sep 06 01:05:33.033004 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: exception: Flavor 84 could not be found. Sep 06 01:05:33.033004 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: action_args: {'id': '84'} Sep 06 01:05:33.033004 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:05:33.033004 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:05:33.033953 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 01:05:33.033953 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 01:05:33.033953 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 01:05:33.033953 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 01:05:33.033953 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 01:05:33.033953 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 01:05:33.033953 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 01:05:33.033953 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 01:05:33.033953 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 01:05:33.033953 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:05:33.033953 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 01:05:33.033953 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 01:05:33.033953 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 06 01:05:33.033953 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Sep 06 01:05:33.033953 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:05:33.033953 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Sep 06 01:05:33.033953 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:05:33.033953 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:05:33.033953 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:05:33.035282 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:05:33.035282 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:05:33.035282 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:05:33.035282 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:05:33.035282 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 01:05:33.035282 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:05:33.035282 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 06 01:05:33.035282 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Sep 06 01:05:33.035282 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:05:33.035282 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Sep 06 01:05:33.035282 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:05:33.035282 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:05:33.035282 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:05:33.035282 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:05:33.035282 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:05:33.035282 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 06 01:05:33.035282 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Sep 06 01:05:33.035282 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-0e60e96f-0a7e-4e02-91a6-4ad4226f9ed2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:05:33.036742 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-0e60e96f-0a7e-4e02-91a6-4ad4226f9ed2 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.388962 Sep 06 01:05:33.036742 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 23/44] 10.222.0.23 () {60 vars in 1190 bytes} [Tue Sep 6 01:05:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 06 01:05:33.042657 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-f88d3c10-2a19-47d0-b7d0-cb3c57828d3e admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:05:33.057785 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-f88d3c10-2a19-47d0-b7d0-cb3c57828d3e admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018983 Sep 06 01:05:33.058306 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 22/45] 10.222.0.23 () {60 vars in 1210 bytes} [Tue Sep 6 01:05:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:05:33.067655 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-3592d0c7-f638-491f-8673-f76368fdc5b8 admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:05:33.082369 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-3592d0c7-f638-491f-8673-f76368fdc5b8 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018133 Sep 06 01:05:33.082887 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 24/46] 10.222.0.23 () {60 vars in 1210 bytes} [Tue Sep 6 01:05:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:05:33.091736 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-8378e601-a3c0-4ff5-90cd-1bcbdd3cd6ce admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:05:33.097328 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.wsgi [None req-8378e601-a3c0-4ff5-90cd-1bcbdd3cd6ce admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 06 01:05:33.098797 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-8378e601-a3c0-4ff5-90cd-1bcbdd3cd6ce admin admin] Request method failure captured: Sep 06 01:05:33.098797 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 06 01:05:33.098797 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: Accept: application/json Sep 06 01:05:33.098797 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: Accept-Encoding: gzip, deflate Sep 06 01:05:33.098797 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: Connection: keep-alive Sep 06 01:05:33.098797 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: Content-Length: 0 Sep 06 01:05:33.098797 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: Host: 10.222.0.23 Sep 06 01:05:33.098797 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: Openstack-Api-Version: compute 2.92 Sep 06 01:05:33.098797 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: Openstack-System-Scope: None Sep 06 01:05:33.098797 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: User-Agent: python-novaclient Sep 06 01:05:33.098797 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Auth-Token: gAAAAABjFpzc9f5bvew6aTmdfLX_9zJnH6Mw5i5Acqg8Ifyn6qzA73TB4UdLKuvYfJswTlyiib8aDFIsDky3EfvI7wzRvOUJHSukuezuP9bSkjjcL4rRWzR2kC_3USII5t3ckeg7t4-_Rpm05zRHFVKKgT6xlBwQyksZ-3-wVhAUXgJVDYRUP3k Sep 06 01:05:33.098797 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Domain-Id: None Sep 06 01:05:33.098797 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Domain-Name: None Sep 06 01:05:33.098797 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Identity-Status: Confirmed Sep 06 01:05:33.098797 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Is-Admin-Project: True Sep 06 01:05:33.098797 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 01:05:33.098797 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Project-Domain-Id: default Sep 06 01:05:33.098797 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Project-Domain-Name: Default Sep 06 01:05:33.098797 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Project-Id: 921fe46fc085463aa0816bc6ba906e3c Sep 06 01:05:33.098797 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Project-Name: admin Sep 06 01:05:33.098797 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Role: reader,member,admin Sep 06 01:05:33.098797 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Roles: reader,member,admin Sep 06 01:05:33.100433 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/921fe46fc085463aa0816bc6ba906e3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/921fe46fc085463aa0816bc6ba906e3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_921fe46fc085463aa0816bc6ba906e3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/921fe46fc085463aa0816bc6ba906e3c"}]}] Sep 06 01:05:33.100433 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Tenant: admin Sep 06 01:05:33.100433 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Tenant-Id: 921fe46fc085463aa0816bc6ba906e3c Sep 06 01:05:33.100433 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Tenant-Name: admin Sep 06 01:05:33.100433 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-User: admin Sep 06 01:05:33.100433 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-User-Domain-Id: default Sep 06 01:05:33.100433 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-User-Domain-Name: Default Sep 06 01:05:33.100433 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-User-Id: 1842912f886f4b17b51cd35bebba1a7e Sep 06 01:05:33.100433 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-User-Name: admin Sep 06 01:05:33.100433 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: method: > Sep 06 01:05:33.100433 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: exception: Flavor 84 could not be found. Sep 06 01:05:33.100433 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: action_args: {'id': '84'} Sep 06 01:05:33.100433 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:05:33.100433 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:05:33.101278 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 01:05:33.101278 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 01:05:33.101278 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 01:05:33.101278 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 01:05:33.101278 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 01:05:33.101278 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 01:05:33.101278 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 01:05:33.101278 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 01:05:33.101278 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 01:05:33.101278 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:05:33.101278 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 01:05:33.101278 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 01:05:33.101278 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 06 01:05:33.101278 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Sep 06 01:05:33.101278 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:05:33.101278 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Sep 06 01:05:33.101278 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:05:33.101278 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:05:33.101278 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:05:33.102964 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:05:33.102964 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:05:33.102964 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:05:33.102964 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:05:33.102964 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 01:05:33.102964 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:05:33.102964 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 06 01:05:33.102964 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Sep 06 01:05:33.102964 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:05:33.102964 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Sep 06 01:05:33.102964 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:05:33.102964 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:05:33.102964 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:05:33.102964 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:05:33.102964 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:05:33.102964 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 06 01:05:33.102964 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Sep 06 01:05:33.102964 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-8378e601-a3c0-4ff5-90cd-1bcbdd3cd6ce admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:05:33.104230 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-8378e601-a3c0-4ff5-90cd-1bcbdd3cd6ce admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011751 Sep 06 01:05:33.104230 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 23/47] 10.222.0.23 () {60 vars in 1190 bytes} [Tue Sep 6 01:05:33 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 06 01:05:34.057899 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-3592d0c7-f638-491f-8673-f76368fdc5b8 admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:05:34.058899 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-3592d0c7-f638-491f-8673-f76368fdc5b8 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Sep 06 01:05:34.059290 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 25/48] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Sep 6 01:05:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:05:34.572121 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-99a93526-ed25-48df-a182-3325b15bd18a admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:05:34.577880 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.wsgi [None req-99a93526-ed25-48df-a182-3325b15bd18a admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 06 01:05:34.579360 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-99a93526-ed25-48df-a182-3325b15bd18a admin admin] Request method failure captured: Sep 06 01:05:34.579360 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 06 01:05:34.579360 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: Accept: application/json Sep 06 01:05:34.579360 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: Accept-Encoding: gzip, deflate Sep 06 01:05:34.579360 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: Connection: keep-alive Sep 06 01:05:34.579360 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: Content-Length: 0 Sep 06 01:05:34.579360 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: Host: 10.222.0.23 Sep 06 01:05:34.579360 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: Openstack-Api-Version: compute 2.92 Sep 06 01:05:34.579360 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: Openstack-System-Scope: None Sep 06 01:05:34.579360 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: User-Agent: python-novaclient Sep 06 01:05:34.579360 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Auth-Token: gAAAAABjFpzdU0ARGYtOpdDVntvNgiEBDpyXnGnq5flwZCKSU6ChEClMXvd77Vk1lXzww000-6vpjENAkOUX_1voAChRgQyKDPTDVqUEJFIrXbhkap5py_qmWkpmTvM1AwoZXQj6ObdvFYXVa6_5qOQR6gS7nWsIoQQb8GR7Z0zZqczWYWvYo5c Sep 06 01:05:34.579360 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Domain-Id: None Sep 06 01:05:34.579360 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Domain-Name: None Sep 06 01:05:34.579360 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Identity-Status: Confirmed Sep 06 01:05:34.579360 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Is-Admin-Project: True Sep 06 01:05:34.579360 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 01:05:34.579360 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Project-Domain-Id: default Sep 06 01:05:34.579360 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Project-Domain-Name: Default Sep 06 01:05:34.579360 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Project-Id: 921fe46fc085463aa0816bc6ba906e3c Sep 06 01:05:34.579360 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Project-Name: admin Sep 06 01:05:34.579360 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Role: reader,member,admin Sep 06 01:05:34.579360 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Roles: reader,member,admin Sep 06 01:05:34.580975 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/921fe46fc085463aa0816bc6ba906e3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/921fe46fc085463aa0816bc6ba906e3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_921fe46fc085463aa0816bc6ba906e3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/921fe46fc085463aa0816bc6ba906e3c"}]}] Sep 06 01:05:34.580975 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Tenant: admin Sep 06 01:05:34.580975 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Tenant-Id: 921fe46fc085463aa0816bc6ba906e3c Sep 06 01:05:34.580975 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-Tenant-Name: admin Sep 06 01:05:34.580975 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-User: admin Sep 06 01:05:34.580975 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-User-Domain-Id: default Sep 06 01:05:34.580975 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-User-Domain-Name: Default Sep 06 01:05:34.580975 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-User-Id: 1842912f886f4b17b51cd35bebba1a7e Sep 06 01:05:34.580975 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: X-User-Name: admin Sep 06 01:05:34.580975 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: method: > Sep 06 01:05:34.580975 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: exception: Flavor 451 could not be found. Sep 06 01:05:34.580975 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: action_args: {'id': '451'} Sep 06 01:05:34.580975 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:05:34.580975 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:05:34.581851 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 01:05:34.581851 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 01:05:34.581851 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 01:05:34.581851 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 01:05:34.581851 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 01:05:34.581851 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 01:05:34.581851 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 01:05:34.581851 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 01:05:34.581851 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 01:05:34.581851 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:05:34.581851 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 01:05:34.581851 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 01:05:34.581851 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 06 01:05:34.581851 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Sep 06 01:05:34.581851 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:05:34.581851 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Sep 06 01:05:34.581851 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:05:34.581851 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:05:34.581851 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:05:34.583146 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:05:34.583146 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:05:34.583146 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:05:34.583146 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:05:34.583146 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 01:05:34.583146 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:05:34.583146 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 06 01:05:34.583146 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Sep 06 01:05:34.583146 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:05:34.583146 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Sep 06 01:05:34.583146 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:05:34.583146 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:05:34.583146 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:05:34.583146 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:05:34.583146 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:05:34.583146 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 06 01:05:34.583146 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: ERROR nova.api.openstack.wsgi Sep 06 01:05:34.583146 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-99a93526-ed25-48df-a182-3325b15bd18a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:05:34.584422 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-99a93526-ed25-48df-a182-3325b15bd18a admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.380737 Sep 06 01:05:34.584422 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 24/49] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Sep 6 01:05:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 382 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 06 01:05:34.590633 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-c4720403-8d5c-43f3-a6cc-ca86fdd42a55 admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:05:34.606108 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-c4720403-8d5c-43f3-a6cc-ca86fdd42a55 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019110 Sep 06 01:05:34.606633 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 26/50] 10.222.0.23 () {60 vars in 1210 bytes} [Tue Sep 6 01:05:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:05:34.616446 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-bcfdb7fe-ad70-4234-8160-bce04fea270f admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:05:34.630924 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-bcfdb7fe-ad70-4234-8160-bce04fea270f admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.017935 Sep 06 01:05:34.631434 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 25/51] 10.222.0.23 () {60 vars in 1210 bytes} [Tue Sep 6 01:05:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:05:34.640385 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-8e52dbe9-388c-42ef-ba6d-fcd94927d774 admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:05:34.645676 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.wsgi [None req-8e52dbe9-388c-42ef-ba6d-fcd94927d774 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 06 01:05:34.647151 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-8e52dbe9-388c-42ef-ba6d-fcd94927d774 admin admin] Request method failure captured: Sep 06 01:05:34.647151 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 06 01:05:34.647151 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: Accept: application/json Sep 06 01:05:34.647151 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: Accept-Encoding: gzip, deflate Sep 06 01:05:34.647151 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: Connection: keep-alive Sep 06 01:05:34.647151 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: Content-Length: 0 Sep 06 01:05:34.647151 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: Host: 10.222.0.23 Sep 06 01:05:34.647151 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: Openstack-Api-Version: compute 2.92 Sep 06 01:05:34.647151 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: Openstack-System-Scope: None Sep 06 01:05:34.647151 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: User-Agent: python-novaclient Sep 06 01:05:34.647151 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Auth-Token: gAAAAABjFpzdU0ARGYtOpdDVntvNgiEBDpyXnGnq5flwZCKSU6ChEClMXvd77Vk1lXzww000-6vpjENAkOUX_1voAChRgQyKDPTDVqUEJFIrXbhkap5py_qmWkpmTvM1AwoZXQj6ObdvFYXVa6_5qOQR6gS7nWsIoQQb8GR7Z0zZqczWYWvYo5c Sep 06 01:05:34.647151 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Domain-Id: None Sep 06 01:05:34.647151 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Domain-Name: None Sep 06 01:05:34.647151 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Identity-Status: Confirmed Sep 06 01:05:34.647151 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Is-Admin-Project: True Sep 06 01:05:34.647151 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 01:05:34.647151 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Project-Domain-Id: default Sep 06 01:05:34.647151 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Project-Domain-Name: Default Sep 06 01:05:34.647151 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Project-Id: 921fe46fc085463aa0816bc6ba906e3c Sep 06 01:05:34.647151 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Project-Name: admin Sep 06 01:05:34.647151 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Role: reader,member,admin Sep 06 01:05:34.647151 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Roles: reader,member,admin Sep 06 01:05:34.648731 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/921fe46fc085463aa0816bc6ba906e3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/921fe46fc085463aa0816bc6ba906e3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_921fe46fc085463aa0816bc6ba906e3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/921fe46fc085463aa0816bc6ba906e3c"}]}] Sep 06 01:05:34.648731 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Tenant: admin Sep 06 01:05:34.648731 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Tenant-Id: 921fe46fc085463aa0816bc6ba906e3c Sep 06 01:05:34.648731 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-Tenant-Name: admin Sep 06 01:05:34.648731 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-User: admin Sep 06 01:05:34.648731 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-User-Domain-Id: default Sep 06 01:05:34.648731 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-User-Domain-Name: Default Sep 06 01:05:34.648731 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-User-Id: 1842912f886f4b17b51cd35bebba1a7e Sep 06 01:05:34.648731 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: X-User-Name: admin Sep 06 01:05:34.648731 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: method: > Sep 06 01:05:34.648731 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: exception: Flavor 451 could not be found. Sep 06 01:05:34.648731 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: action_args: {'id': '451'} Sep 06 01:05:34.648731 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:05:34.648731 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:05:34.649696 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 01:05:34.649696 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 01:05:34.649696 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 01:05:34.649696 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 01:05:34.649696 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 01:05:34.649696 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 01:05:34.649696 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 01:05:34.649696 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 01:05:34.649696 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 01:05:34.649696 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:05:34.649696 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 01:05:34.649696 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 01:05:34.649696 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 06 01:05:34.649696 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Sep 06 01:05:34.649696 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:05:34.649696 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Sep 06 01:05:34.649696 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:05:34.649696 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:05:34.649696 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:05:34.651002 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:05:34.651002 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:05:34.651002 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:05:34.651002 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:05:34.651002 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 01:05:34.651002 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:05:34.651002 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 06 01:05:34.651002 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Sep 06 01:05:34.651002 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:05:34.651002 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Sep 06 01:05:34.651002 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:05:34.651002 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:05:34.651002 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:05:34.651002 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:05:34.651002 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:05:34.651002 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 06 01:05:34.651002 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Sep 06 01:05:34.651002 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-8e52dbe9-388c-42ef-ba6d-fcd94927d774 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:05:34.652254 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-8e52dbe9-388c-42ef-ba6d-fcd94927d774 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011612 Sep 06 01:05:34.652254 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 27/52] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Sep 6 01:05:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 06 01:05:35.618362 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-bcfdb7fe-ad70-4234-8160-bce04fea270f admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:05:35.619361 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-bcfdb7fe-ad70-4234-8160-bce04fea270f admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Sep 06 01:05:35.619770 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 26/53] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Sep 6 01:05:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:05:36.262753 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-192cb52e-ba0c-49aa-b219-f1f5ebd7b170 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:05:36.281718 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-192cb52e-ba0c-49aa-b219-f1f5ebd7b170 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.522696 Sep 06 01:05:36.282251 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 28/54] 10.222.0.23 () {64 vars in 1235 bytes} [Tue Sep 6 01:05:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 01:05:37.243429 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-bcfdb7fe-ad70-4234-8160-bce04fea270f admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:05:37.244457 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-bcfdb7fe-ad70-4234-8160-bce04fea270f admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Sep 06 01:05:37.244851 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 27/55] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Sep 6 01:05:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:05:37.767919 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-bc80e6c0-a900-4666-8616-7f0655b35539 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:05:37.786695 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-bc80e6c0-a900-4666-8616-7f0655b35539 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.402867 Sep 06 01:05:37.787230 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 29/56] 10.222.0.23 () {64 vars in 1235 bytes} [Tue Sep 6 01:05:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 01:05:38.769851 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-bcfdb7fe-ad70-4234-8160-bce04fea270f admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:05:38.770846 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-bcfdb7fe-ad70-4234-8160-bce04fea270f admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Sep 06 01:05:38.771241 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 28/57] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Sep 6 01:05:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:05:39.289850 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-53ea8b2f-0bee-45e8-8cc5-18295de72db9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:05:39.308299 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-53ea8b2f-0bee-45e8-8cc5-18295de72db9 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.397052 Sep 06 01:05:39.309004 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 30/58] 10.222.0.23 () {64 vars in 1235 bytes} [Tue Sep 6 01:05:38 2022] POST /compute/v2.1/flavors => generated 407 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 01:05:40.263946 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-bcfdb7fe-ad70-4234-8160-bce04fea270f admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:05:40.264977 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-bcfdb7fe-ad70-4234-8160-bce04fea270f admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Sep 06 01:05:40.265374 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 29/59] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Sep 6 01:05:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:05:40.781156 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-9fc087fe-b18b-4ce0-a4f0-8c1012040de9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:05:40.799250 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-9fc087fe-b18b-4ce0-a4f0-8c1012040de9 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.397702 Sep 06 01:05:40.799825 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 31/60] 10.222.0.23 () {64 vars in 1235 bytes} [Tue Sep 6 01:05:40 2022] POST /compute/v2.1/flavors => generated 409 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 01:05:41.761364 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-bcfdb7fe-ad70-4234-8160-bce04fea270f admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:05:41.762349 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-bcfdb7fe-ad70-4234-8160-bce04fea270f admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 Sep 06 01:05:41.762737 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 30/61] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Sep 6 01:05:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:05:42.281631 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-31813af7-2a98-4c78-9f32-11233b640e6c admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:05:42.301664 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-31813af7-2a98-4c78-9f32-11233b640e6c admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.398755 Sep 06 01:05:42.302192 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 32/62] 10.222.0.23 () {60 vars in 1202 bytes} [Tue Sep 6 01:05:41 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:06:35.306730 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-bcfdb7fe-ad70-4234-8160-bce04fea270f admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:06:35.307807 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-bcfdb7fe-ad70-4234-8160-bce04fea270f admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Sep 06 01:06:35.308213 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 31/63] 10.222.0.23 () {54 vars in 931 bytes} [Tue Sep 6 01:06:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:06:35.319311 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG dbcounter [-] [105587] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:06:35.694300 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-ae1221b2-8ab0-4529-a7ed-e1fbde2d47cf admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:06:35.718423 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-ae1221b2-8ab0-4529-a7ed-e1fbde2d47cf admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.403497 Sep 06 01:06:35.718961 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 33/64] 10.222.0.23 () {60 vars in 1292 bytes} [Tue Sep 6 01:06:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:06:35.740280 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG dbcounter [-] [105588] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=105588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:06:35.744122 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-8e73c7e3-9780-4222-b681-5b2603a4453e admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:06:35.753000 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-8e73c7e3-9780-4222-b681-5b2603a4453e admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014184 Sep 06 01:06:35.753543 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 32/65] 10.222.0.23 () {60 vars in 1283 bytes} [Tue Sep 6 01:06:35 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:06:35.765304 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-8bba6092-fe3a-4276-bc3b-33edbe6f005c admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:06:35.772830 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-8bba6092-fe3a-4276-bc3b-33edbe6f005c admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011062 Sep 06 01:06:35.773340 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 34/66] 10.222.0.23 () {60 vars in 1286 bytes} [Tue Sep 6 01:06:35 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:06:35.784382 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-e2b4c708-bfff-47e7-aaad-90fb124797e8 admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:06:35.792681 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-e2b4c708-bfff-47e7-aaad-90fb124797e8 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011698 Sep 06 01:06:35.793200 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 33/67] 10.222.0.23 () {60 vars in 1286 bytes} [Tue Sep 6 01:06:35 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:06:35.804441 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-a9667699-2fd5-4f29-82d0-c77d276afed0 admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:06:35.811871 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-a9667699-2fd5-4f29-82d0-c77d276afed0 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010654 Sep 06 01:06:35.812837 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 35/68] 10.222.0.23 () {60 vars in 1283 bytes} [Tue Sep 6 01:06:35 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:09:32.062989 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-e2b4c708-bfff-47e7-aaad-90fb124797e8 admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:09:32.064034 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-e2b4c708-bfff-47e7-aaad-90fb124797e8 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Sep 06 01:09:32.064421 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 34/69] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Sep 6 01:09:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:09:32.207306 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG dbcounter [-] [105587] Writing DB stats nova_api:SELECT=6 {{(pid=105587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:09:32.362978 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-16ffff6b-ec20-49f2-a390-3673d80f032e admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:09:32.366390 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG oslo_concurrency.lockutils [None req-16ffff6b-ec20-49f2-a390-3673d80f032e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:09:32.366866 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG oslo_concurrency.lockutils [None req-16ffff6b-ec20-49f2-a390-3673d80f032e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:09:32.367294 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG oslo_concurrency.lockutils [None req-16ffff6b-ec20-49f2-a390-3673d80f032e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:09:32.368066 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG oslo_concurrency.lockutils [None req-16ffff6b-ec20-49f2-a390-3673d80f032e admin admin] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:09:32.368510 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG oslo_concurrency.lockutils [None req-16ffff6b-ec20-49f2-a390-3673d80f032e admin admin] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:09:32.368926 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG oslo_concurrency.lockutils [None req-16ffff6b-ec20-49f2-a390-3673d80f032e admin admin] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:09:32.402032 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-16ffff6b-ec20-49f2-a390-3673d80f032e admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.196106 Sep 06 01:09:32.402579 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 36/70] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Sep 6 01:09:32 2022] GET /compute/v2.1/os-services => generated 791 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 01:09:33.242917 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-e2b4c708-bfff-47e7-aaad-90fb124797e8 admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:09:33.244029 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-e2b4c708-bfff-47e7-aaad-90fb124797e8 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Sep 06 01:09:33.244431 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 35/71] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Sep 6 01:09:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:09:33.432520 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-eae2fbfa-28ea-4122-adeb-b4fa5f3976af admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:09:33.435921 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG oslo_concurrency.lockutils [None req-eae2fbfa-28ea-4122-adeb-b4fa5f3976af admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:09:33.436412 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG oslo_concurrency.lockutils [None req-eae2fbfa-28ea-4122-adeb-b4fa5f3976af admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:09:33.436830 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG oslo_concurrency.lockutils [None req-eae2fbfa-28ea-4122-adeb-b4fa5f3976af admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:09:33.437527 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG oslo_concurrency.lockutils [None req-eae2fbfa-28ea-4122-adeb-b4fa5f3976af admin admin] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:09:33.437967 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG oslo_concurrency.lockutils [None req-eae2fbfa-28ea-4122-adeb-b4fa5f3976af admin admin] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:09:33.438373 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG oslo_concurrency.lockutils [None req-eae2fbfa-28ea-4122-adeb-b4fa5f3976af admin admin] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:09:33.458328 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-eae2fbfa-28ea-4122-adeb-b4fa5f3976af admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.077144 Sep 06 01:09:33.458870 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 37/72] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Sep 6 01:09:33 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 01:09:44.719272 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-e2b4c708-bfff-47e7-aaad-90fb124797e8 admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:09:44.720294 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-e2b4c708-bfff-47e7-aaad-90fb124797e8 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Sep 06 01:09:44.720679 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 36/73] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Sep 6 01:09:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:09:44.861546 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG dbcounter [-] [105587] Writing DB stats nova_cell0:SELECT=4 {{(pid=105587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:09:44.862177 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG dbcounter [-] [105587] Writing DB stats nova_cell1:SELECT=4 {{(pid=105587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:09:44.862777 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG dbcounter [-] [105587] Writing DB stats nova_api:SELECT=8 {{(pid=105587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:09:44.910068 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-02bf5a0b-3e36-4664-a196-ac675cd23970 admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:09:44.913407 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG oslo_concurrency.lockutils [None req-02bf5a0b-3e36-4664-a196-ac675cd23970 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:09:44.913886 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG oslo_concurrency.lockutils [None req-02bf5a0b-3e36-4664-a196-ac675cd23970 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:09:44.914312 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG oslo_concurrency.lockutils [None req-02bf5a0b-3e36-4664-a196-ac675cd23970 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:09:44.915014 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG oslo_concurrency.lockutils [None req-02bf5a0b-3e36-4664-a196-ac675cd23970 admin admin] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:09:44.915456 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG oslo_concurrency.lockutils [None req-02bf5a0b-3e36-4664-a196-ac675cd23970 admin admin] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:09:44.915895 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG oslo_concurrency.lockutils [None req-02bf5a0b-3e36-4664-a196-ac675cd23970 admin admin] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:09:44.940388 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-02bf5a0b-3e36-4664-a196-ac675cd23970 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.083311 Sep 06 01:09:44.940930 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 38/74] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Sep 6 01:09:44 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:09:45.753091 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: DEBUG nova.api.openstack.wsgi [None req-e2b4c708-bfff-47e7-aaad-90fb124797e8 admin admin] Calling method '>' {{(pid=105588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:09:45.754083 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: INFO nova.api.openstack.requestlog [None req-e2b4c708-bfff-47e7-aaad-90fb124797e8 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Sep 06 01:09:45.754477 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: [pid: 105588|app: 0|req: 37/75] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Sep 6 01:09:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:09:45.941852 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-542e7fdf-c59f-4347-8564-b874508640c8 admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:09:45.945277 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG oslo_concurrency.lockutils [None req-542e7fdf-c59f-4347-8564-b874508640c8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:09:45.945756 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG oslo_concurrency.lockutils [None req-542e7fdf-c59f-4347-8564-b874508640c8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:09:45.946188 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG oslo_concurrency.lockutils [None req-542e7fdf-c59f-4347-8564-b874508640c8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:09:45.946901 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG oslo_concurrency.lockutils [None req-542e7fdf-c59f-4347-8564-b874508640c8 admin admin] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:09:45.947345 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG oslo_concurrency.lockutils [None req-542e7fdf-c59f-4347-8564-b874508640c8 admin admin] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:09:45.947784 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: DEBUG oslo_concurrency.lockutils [None req-542e7fdf-c59f-4347-8564-b874508640c8 admin admin] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:09:45.969468 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-542e7fdf-c59f-4347-8564-b874508640c8 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.078557 Sep 06 01:09:45.969954 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 39/76] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Sep 6 01:09:45 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:10:41.004039 dv-cinder-847732-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 06 01:10:41.004887 dv-cinder-847732-2-iscsi devstack@n-api.service[105586]: Tue Sep 6 01:10:41 2022 - graceful shutdown triggered... Sep 06 01:10:41.005455 dv-cinder-847732-2-iscsi devstack@n-api.service[105587]: Gracefully killing worker 1 (pid: 105587)... Sep 06 01:10:41.005917 dv-cinder-847732-2-iscsi devstack@n-api.service[105588]: Gracefully killing worker 2 (pid: 105588)... Sep 06 01:10:42.005610 dv-cinder-847732-2-iscsi devstack@n-api.service[105586]: worker 1 buried after 1 seconds Sep 06 01:10:42.006119 dv-cinder-847732-2-iscsi devstack@n-api.service[105586]: worker 2 buried after 1 seconds Sep 06 01:10:42.006119 dv-cinder-847732-2-iscsi devstack@n-api.service[105586]: goodbye to uWSGI. Sep 06 01:10:42.007219 dv-cinder-847732-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 06 01:10:42.007807 dv-cinder-847732-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 06 01:10:42.010643 dv-cinder-847732-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 06 01:10:42.024622 dv-cinder-847732-2-iscsi devstack@n-api.service[120567]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 06 01:10:42.028019 dv-cinder-847732-2-iscsi devstack@n-api.service[120567]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 6 01:10:42 2022] *** Sep 06 01:10:42.028243 dv-cinder-847732-2-iscsi devstack@n-api.service[120567]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 06 01:10:42.028541 dv-cinder-847732-2-iscsi devstack@n-api.service[120567]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 06 01:10:42.028541 dv-cinder-847732-2-iscsi devstack@n-api.service[120567]: nodename: dv-cinder-847732-2-iscsi Sep 06 01:10:42.028541 dv-cinder-847732-2-iscsi devstack@n-api.service[120567]: machine: x86_64 Sep 06 01:10:42.028541 dv-cinder-847732-2-iscsi devstack@n-api.service[120567]: clock source: unix Sep 06 01:10:42.028541 dv-cinder-847732-2-iscsi devstack@n-api.service[120567]: pcre jit disabled Sep 06 01:10:42.028541 dv-cinder-847732-2-iscsi devstack@n-api.service[120567]: detected number of CPU cores: 4 Sep 06 01:10:42.028541 dv-cinder-847732-2-iscsi devstack@n-api.service[120567]: current working directory: / Sep 06 01:10:42.028541 dv-cinder-847732-2-iscsi devstack@n-api.service[120567]: detected binary path: /usr/bin/uwsgi-core Sep 06 01:10:42.028541 dv-cinder-847732-2-iscsi devstack@n-api.service[120567]: your processes number limit is 47680 Sep 06 01:10:42.028541 dv-cinder-847732-2-iscsi devstack@n-api.service[120567]: your memory page size is 4096 bytes Sep 06 01:10:42.028541 dv-cinder-847732-2-iscsi devstack@n-api.service[120567]: detected max file descriptor number: 2048 Sep 06 01:10:42.028541 dv-cinder-847732-2-iscsi devstack@n-api.service[120567]: lock engine: pthread robust mutexes Sep 06 01:10:42.029408 dv-cinder-847732-2-iscsi devstack@n-api.service[120567]: thunder lock: enabled Sep 06 01:10:42.029408 dv-cinder-847732-2-iscsi devstack@n-api.service[120567]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 06 01:10:42.029408 dv-cinder-847732-2-iscsi devstack@n-api.service[120567]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 06 01:10:42.071231 dv-cinder-847732-2-iscsi devstack@n-api.service[120567]: Python main interpreter initialized at 0x55f711d7a9c0 Sep 06 01:10:42.071231 dv-cinder-847732-2-iscsi devstack@n-api.service[120567]: python threads support enabled Sep 06 01:10:42.071231 dv-cinder-847732-2-iscsi devstack@n-api.service[120567]: your server socket listen backlog is limited to 100 connections Sep 06 01:10:42.071231 dv-cinder-847732-2-iscsi devstack@n-api.service[120567]: your mercy for graceful operations on workers is 90 seconds Sep 06 01:10:42.071701 dv-cinder-847732-2-iscsi devstack@n-api.service[120567]: mapped 403077 bytes (393 KB) for 2 cores Sep 06 01:10:42.071701 dv-cinder-847732-2-iscsi devstack@n-api.service[120567]: *** Operational MODE: preforking *** Sep 06 01:10:42.071958 dv-cinder-847732-2-iscsi devstack@n-api.service[120567]: *** uWSGI is running in multiple interpreter mode *** Sep 06 01:10:42.071958 dv-cinder-847732-2-iscsi devstack@n-api.service[120567]: spawned uWSGI master process (pid: 120567) Sep 06 01:10:42.072179 dv-cinder-847732-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 06 01:10:42.072750 dv-cinder-847732-2-iscsi devstack@n-api.service[120567]: spawned uWSGI worker 1 (pid: 120580, cores: 1) Sep 06 01:10:42.073245 dv-cinder-847732-2-iscsi devstack@n-api.service[120567]: spawned uWSGI worker 2 (pid: 120581, cores: 1) Sep 06 01:10:42.073537 dv-cinder-847732-2-iscsi devstack@n-api.service[120567]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 06 01:10:42.728170 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 06 01:10:42.734822 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 06 01:10:43.906053 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 01:10:43.906053 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: from cryptography.utils import int_from_bytes Sep 06 01:10:43.906770 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 01:10:43.906770 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: from cryptography.utils import int_from_bytes Sep 06 01:10:43.907919 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 01:10:43.907919 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: from cryptography.utils import int_from_bytes Sep 06 01:10:43.908369 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 01:10:43.908369 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: from cryptography.utils import int_from_bytes Sep 06 01:10:46.318635 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 01:10:46.319172 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 01:10:46.319444 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 01:10:46.319725 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 01:10:46.320014 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 01:10:46.320411 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.320748 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.320953 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 01:10:46.321342 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.321421 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 01:10:46.321505 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.321722 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.321900 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 01:10:46.322055 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.322150 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 01:10:46.322336 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 01:10:46.322442 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.322682 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.322791 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.323019 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.323120 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.323290 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.323400 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.323649 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.324374 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.324682 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847732-2-iscsi {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.324856 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.325022 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.325181 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.325332 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.325532 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.325689 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.325843 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.325996 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.326172 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.326318 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.326470 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.326629 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.326779 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.326923 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.327090 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847732-2-iscsi {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.327243 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.327391 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.327553 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.327850 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.328178 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.328490 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.328813 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.329136 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.329364 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.329647 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.329954 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.330123 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.330278 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.330519 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.330706 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.330959 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.331138 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.331302 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.331454 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.331709 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.331934 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.332107 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.332295 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.332456 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.332705 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.332885 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.333118 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847732-2-iscsi {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.333411 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.333584 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.333744 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.333889 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.334033 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.334189 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.334437 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.334603 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847732-2-iscsi {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.334748 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.334976 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.335147 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.335302 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.335460 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.335649 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.335820 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.335983 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.336144 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.336289 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.336440 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.336597 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.336750 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.336908 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.337054 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.337206 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.337362 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.337507 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.337666 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.337907 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.338062 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.338213 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.338358 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.338502 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.338665 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.338843 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.339098 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.339461 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.339614 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.339942 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.340105 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.340257 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.340408 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.340571 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.340802 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.340954 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.341124 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.341282 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.341433 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.341580 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.341747 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.341974 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.342134 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.342282 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.342518 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.342671 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.342818 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.342973 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.343154 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.343395 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.343613 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.343814 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.343982 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.344138 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.344292 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.344443 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.344594 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.344752 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.344911 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.345068 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.345212 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.345362 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.345512 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.345704 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.345863 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.346011 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.346161 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.346315 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.346459 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.346612 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.346772 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.346917 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.347072 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.347223 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.347367 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.347526 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.347670 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.347839 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.347996 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.348142 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.348284 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.348437 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.348587 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.348740 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.348891 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.348891 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.349292 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.349292 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.349779 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.349951 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.350198 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.350198 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.350502 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.350661 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.350830 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.351051 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.351202 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.351365 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.351531 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.351685 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.351884 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.352116 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.352277 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.352423 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.352659 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.352821 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.352974 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.353118 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.353262 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.353493 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.354304 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.354472 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.354690 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.354850 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.354996 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.355149 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.355315 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.355469 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.355620 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.355830 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.355982 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.356126 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.356287 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.356452 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.356605 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.356749 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.356899 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.357056 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.357202 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.357351 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.357504 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.357650 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.357811 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.357970 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.358122 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.358273 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.358428 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.358574 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.358726 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.358881 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.359032 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.359182 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.359425 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.359798 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.359968 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.360123 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.360376 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.360539 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.360697 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.360853 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.361005 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.361251 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.361408 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.361564 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.361727 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.361874 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.362025 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.362254 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.362414 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.362561 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.362786 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.362948 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.362948 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.363235 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.363387 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.363624 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.363803 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.363967 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.364129 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.364300 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.364519 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.364670 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.364822 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.364975 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.365144 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.365290 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.365433 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.365585 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.365728 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.365923 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.366082 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.366227 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.366371 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.366526 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.366670 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.366814 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.366967 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.367123 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.367275 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.367420 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.367563 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.367731 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.368100 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.368262 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.368414 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.368560 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.368704 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.368957 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.369777 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.370091 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.370258 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.370432 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.371159 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.371411 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.371571 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.371729 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.371898 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.372054 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.372201 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.372442 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.372601 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.372764 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.372990 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.373086 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.373255 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.373401 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.373546 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.373788 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 01:10:46.373948 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.374095 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.374250 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.374396 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.374632 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.374788 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.374933 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.375090 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.375244 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.375398 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.375557 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.375710 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.375935 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.376102 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.376248 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.376394 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.376545 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.376691 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.376835 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.377011 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.377170 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.377321 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.377466 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.377610 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.377760 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.377908 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.378061 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.378206 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.378349 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.378349 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.378760 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.378921 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.378921 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.379224 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.379367 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.379607 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.379781 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.380033 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.380282 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.380440 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.380593 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.380738 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.380890 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.381048 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.381293 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.381553 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.381706 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.381851 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.382002 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.382165 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.382317 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.382543 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.382704 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.382704 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.383073 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.383237 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.383384 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.383540 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.383693 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.383982 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.384137 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.384291 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.384565 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.384801 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.384951 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.385096 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.385250 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.385402 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.385564 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.385716 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.385880 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.386081 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.386864 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.387024 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.387177 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.387330 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.387486 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.387630 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.387807 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.387970 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.388123 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.388268 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.388419 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.388575 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.388734 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.388887 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.389041 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.389186 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.389186 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.389468 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.389712 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.389875 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.390108 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.390287 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.390517 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.390677 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.390994 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.391163 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.391422 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.391659 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.391824 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.391991 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.392147 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.392292 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.392435 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.392631 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.392781 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.392935 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.393165 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.393337 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.393495 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.393642 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.393793 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.394040 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.394194 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.394340 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.394491 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.394724 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.394967 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.395118 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.395265 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.395420 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.395565 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.395723 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.395926 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.396126 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.396284 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.396431 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.396575 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.396720 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.396875 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.397020 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.397164 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.397308 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.397471 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.397624 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.397778 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.397934 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.398078 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.398230 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.398382 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.398538 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.398689 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.398840 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.398991 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.399144 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.399294 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.399576 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.399872 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.400035 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.400261 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.400418 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.400666 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.400828 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.400985 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.401138 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.401292 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.401540 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.401799 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.401964 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.402121 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.402267 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.402410 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.402410 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.402701 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.402854 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.403006 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.403151 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.403395 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.403543 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.403702 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.403919 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.404160 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.404311 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.404455 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.404598 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.404835 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.405090 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.405320 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.405485 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.405640 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.405786 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.405939 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.406091 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.406276 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.406435 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.406588 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.406746 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.406892 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.407049 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.407195 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.407338 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.407483 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.407636 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.407816 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.407969 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.408113 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.408265 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.408419 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.408575 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.408727 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.408880 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.409024 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.409174 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.409319 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.409474 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.409626 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.409778 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.410017 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.410170 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.410405 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.410582 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.410835 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.410995 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.411149 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.411301 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.411456 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.411698 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.411936 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.412099 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.412246 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.412390 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.412550 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.412712 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.412859 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.413003 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.413003 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.413365 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.413529 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.413682 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.413836 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.413989 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.414229 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.414397 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.414551 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.414697 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.414931 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.415105 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.415324 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.415482 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.415634 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.415836 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.415988 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.416133 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.416334 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.416536 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.416686 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.416831 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.416982 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.417138 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.417291 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.417473 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.417626 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.417778 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.417931 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.418086 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.418238 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.418394 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.418545 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.418941 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.419092 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.419244 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.419413 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.419566 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.419710 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.419878 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.420111 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.420273 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.420516 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.420675 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.420932 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.421093 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.421247 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.421401 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.421561 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.421820 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.422062 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.422221 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.422375 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.422521 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.422687 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.422687 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.422969 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.423113 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.423522 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.424383 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.424554 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.424716 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.424878 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.425117 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.425596 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.425750 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.425896 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.426040 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.426195 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.426383 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.426537 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.426683 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.426829 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.427002 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.427157 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.427309 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.427461 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.427607 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.427790 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.427974 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.428121 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.428265 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.428409 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.428552 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.428696 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.428861 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.429007 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.429152 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.429305 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.429450 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.429602 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.429760 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.430022 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.430277 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.430443 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.430855 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.431199 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.431369 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.431540 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.431700 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.431886 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.432226 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.432471 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.432627 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.432787 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.433454 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.433719 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.433885 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.434054 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.434213 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.434474 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.434648 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.434807 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.434966 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.435296 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.435452 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.435698 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.435930 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.436085 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.436245 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.436407 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.436612 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.437000 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.437158 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.437332 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.437499 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.437700 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.437863 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.438188 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.438359 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.438514 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.438680 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.438866 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.438967 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.439055 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.439147 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.439233 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.439337 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.439432 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.439518 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.439601 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.439684 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.439684 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.439907 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.440001 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.440088 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.440172 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.440367 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.440367 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.440549 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.440642 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.440804 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.440902 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.440988 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.441083 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.441195 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.441328 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.441328 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.441497 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.441598 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.441693 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.441779 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.441870 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.441965 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.442051 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.442150 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.442420 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.442527 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.442623 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.442719 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.442812 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.442905 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.442997 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.443083 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.443169 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.443169 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.443341 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.443427 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.443519 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.443611 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.443611 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.443946 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.444051 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.444153 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.444240 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.444324 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.444422 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.444531 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.444626 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.444712 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.444804 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.444898 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.444991 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.445075 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.445184 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.445280 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.445367 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.445458 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.445542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.445626 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.445855 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.445963 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.446059 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.446151 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.446237 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.446321 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.446411 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.446528 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.446623 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.446710 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.446801 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.446893 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.446978 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.447070 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.447163 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.447249 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.447340 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.447425 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.447517 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.447604 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.447604 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.447798 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.447895 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.447988 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.448086 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.448172 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.448264 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.448348 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.448440 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.448531 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.449226 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.449333 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.449416 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.449489 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.449568 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.449653 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.449653 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.449830 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.449923 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.450008 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.450091 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.450224 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.450312 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.450525 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.450627 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.450722 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.450809 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.450904 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.450985 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.451057 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.451140 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.451223 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.451307 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.451404 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.451493 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.451566 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.451655 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.451771 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.451862 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.451959 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.452046 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.452136 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.452221 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.452312 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.452442 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.452526 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.452618 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.452704 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.452787 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.452869 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.452961 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.453053 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.453138 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.453222 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.453306 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.453396 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.453493 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.453578 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.453670 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.453754 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.453837 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.454072 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.454182 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.454277 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.454362 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.454446 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.454529 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.454686 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.454782 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.454874 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.454960 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.455043 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.455134 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.455231 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.455317 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.455401 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.455487 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.455574 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.455658 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.455787 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.455897 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.455986 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.456080 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.456166 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.456250 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.456346 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.456432 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.456524 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.456616 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.456690 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.456786 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.456872 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.456957 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.457030 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.457108 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.457186 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.457271 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.457271 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.457433 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.457518 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.457601 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.457690 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.457787 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.457877 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.457961 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.458044 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.458134 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.458218 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.458310 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.458394 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.458477 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.458559 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.458649 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.458801 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.458894 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.458987 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.459072 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.459155 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.459238 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.459330 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.459422 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.459506 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.459589 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.459679 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.459790 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.459891 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.459977 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.460068 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.460153 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.460244 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.460328 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.460420 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.460522 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.460604 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.460686 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.460772 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.460865 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.460958 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.461043 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.461128 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.461201 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.461430 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.461550 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.461730 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.461824 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.462050 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.462152 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.462363 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.462465 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.462674 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.462775 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.462995 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.463087 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.463382 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.463484 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.463701 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.463903 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.464097 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.464213 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.464399 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.464503 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.464712 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.464795 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.465070 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.465159 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.465396 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.465480 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.465714 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.465810 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.466030 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.466131 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.466340 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.466432 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.466652 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.466741 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.466963 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.467043 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.467271 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.467353 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.467580 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.467663 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.468111 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.468390 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.468720 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.469050 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.469139 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.469387 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.469496 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.469700 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.469802 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.470015 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.470108 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.470333 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.470424 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.470648 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.470740 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.470966 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.471066 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.471286 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.471381 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.471605 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.471707 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.471968 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.472101 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.472366 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.472499 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.472686 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.472815 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.473132 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.473243 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.473350 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.473450 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.473611 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.473705 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.473927 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.474020 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.474239 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.474346 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.474575 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.474680 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.474890 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.474993 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.475200 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.475334 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.475516 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.475650 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.475849 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.475994 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.476174 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.476338 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.476487 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.476595 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.476903 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.476995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.477218 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.477324 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.477535 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.477626 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.477839 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.477938 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.478148 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.478242 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.478454 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.478546 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.478770 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.478910 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.479074 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.479176 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.479390 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.479482 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.480362 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.480482 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.480679 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.480779 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.480993 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.481094 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.481308 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.481416 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.481626 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.481726 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.481940 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.482033 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.482258 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.482365 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.482592 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.482692 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.482905 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.482997 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.483219 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.483321 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.483530 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.483630 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.483863 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.483961 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.484181 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.484360 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.484506 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.484616 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.484819 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.484924 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.485142 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.485243 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.485450 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.485551 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.485778 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.485942 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.486106 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.486259 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.486424 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.486576 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.486750 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.486908 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.487169 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.487261 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.487498 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.487598 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.487833 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.487929 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.488160 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.488252 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.488488 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.488587 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.488797 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.488897 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.489105 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.489205 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.489417 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.489516 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.489728 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.489860 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.490036 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.490144 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.490363 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.490469 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.490670 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.490774 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.491029 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.491134 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.491295 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.491429 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.491607 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.491872 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.491972 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.492212 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.492314 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.492536 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.492638 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.492865 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.492956 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.493190 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.493321 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.493503 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.493597 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.493814 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.493928 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.494139 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.494271 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.494449 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.494552 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.494768 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.494875 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.495073 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.495189 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.495379 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.495525 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.496273 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.496384 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.496596 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.496714 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.496913 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.497016 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.497226 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.497327 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.497539 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.497643 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.497870 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.497967 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.498184 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.498286 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.498505 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.498615 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.498823 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.498915 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.499153 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.499253 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.499474 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.499568 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.499807 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.500251 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.500425 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.500576 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.500735 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.500886 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.501031 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.501172 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.501262 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.501347 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.501446 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.501628 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.501721 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.501934 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.502049 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.502304 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.502408 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.502542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.502685 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.502845 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.503027 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.503150 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.503369 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.503461 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.503689 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.503803 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.504058 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.504169 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.504392 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.504500 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.504701 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.504794 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.505006 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.505122 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.505320 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.505457 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.505626 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.505741 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.505969 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.506081 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.506273 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.506377 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.506610 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.506709 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.506908 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.507019 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.507218 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.507321 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.507533 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.507645 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.507873 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.507990 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.508185 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.508291 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.508500 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.508595 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.508812 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.508913 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.509146 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.509239 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.509461 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.509568 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.509782 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.509874 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.510099 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.510192 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.510411 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.510570 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.510725 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.510828 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.511037 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.511936 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.512058 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.512322 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.512430 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.512586 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.512701 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.512902 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.513003 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.513217 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.513309 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.513535 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.513627 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.513851 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.513959 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.514169 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.514270 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.514482 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.514581 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.514796 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.514956 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.515114 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.515265 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.515415 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.515557 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.515726 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.515907 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.516067 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.516211 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.516378 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.516515 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.516688 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.516804 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.517054 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.517251 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.517372 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.517592 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.517696 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.517917 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.518035 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.518239 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.518339 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.518561 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.518657 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.518883 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.518976 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.519207 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.519307 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.519528 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.519622 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.519875 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.519975 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.520186 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.520278 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.520502 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.520592 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.520954 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.521039 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.521113 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.521193 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.521409 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.521520 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.521721 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.521814 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.522035 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.522148 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.522358 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.522470 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.522730 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.522824 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.523001 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.523108 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.523313 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.523406 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.523626 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.523725 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.523977 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.524071 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.524365 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.524495 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.524691 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.524843 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.525016 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.525141 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.525336 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.525468 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.525656 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.525798 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.525979 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.526115 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.526300 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.526431 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.526618 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.527374 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.527478 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.527689 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.527866 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.528025 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.528140 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.528337 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.528476 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.528647 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.528820 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.528954 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.529147 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.529277 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.529471 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.529591 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.529793 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.529893 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.530117 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.530219 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.530500 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.530649 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.530977 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.531067 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.531324 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.531424 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.531668 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.531780 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.532022 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.532115 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.532349 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.532441 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.532669 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.532796 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.532975 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.533091 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.533301 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.533397 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.533609 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.533718 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.533917 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.534019 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.534234 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.534334 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.534542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.534632 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.534850 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.534978 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.535154 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.535305 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.535464 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.535565 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.535802 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.535915 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.536105 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.536206 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.536416 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.536648 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.536741 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.537000 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.537101 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.537323 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.537415 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.537627 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.537738 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.537933 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.538025 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.538246 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.538337 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.538552 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.538653 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.538858 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.538958 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.539164 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.539265 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.539468 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.539574 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.539805 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.539945 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.540115 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.540216 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.540456 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.540609 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.540766 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.540855 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.541074 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.541166 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.541390 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.541563 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.541710 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.541841 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.542028 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.542167 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.542998 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.543117 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.543214 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.543307 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.543495 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.543912 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.544098 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.544412 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.544731 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.544840 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.545045 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.545144 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.545357 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.545459 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.545669 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.545769 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.545980 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.546090 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.546298 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.546399 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.546612 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.546744 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.547018 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.547198 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.547331 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.547539 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.547676 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.547889 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.548026 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.548227 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.548328 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.548564 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.548666 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.548875 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.548967 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.549184 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.549288 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.549491 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.549584 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.549818 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.549919 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.550131 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.550230 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.550446 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.550547 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.550757 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.550858 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.551070 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.551162 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.551381 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.551473 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.551691 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.551821 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.552033 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.552312 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.552413 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.552642 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.552733 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.552951 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.553215 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.553314 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.553408 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.553556 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.553659 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.553869 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.553961 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.554182 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.554282 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.554502 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.554646 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.554866 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.554961 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.555182 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.555283 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.555499 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.555604 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.555838 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.555947 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.556156 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.556255 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.556472 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.556572 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.556782 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.556881 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.557093 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.557193 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.557405 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.557499 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.557720 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.557819 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.558655 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.558759 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.558978 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.559077 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.559284 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.559376 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.559605 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.559705 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.559952 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.560058 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.560280 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.560372 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.560633 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.560734 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.560964 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.561064 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.561287 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.561387 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.561609 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.561709 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.561921 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.562023 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.562242 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.562375 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.562554 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.562657 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.562870 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.562970 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.563196 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.563315 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.563518 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.563635 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.563868 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.563980 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.564178 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.564281 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.564484 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.564578 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.564793 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.564930 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.565104 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.565273 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.565423 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.565576 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.565719 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.565861 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.566010 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.566166 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.566316 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.566497 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.566646 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.566833 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.566971 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.567152 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.567262 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.567481 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.567582 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.567812 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.567925 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.568126 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.568227 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.568432 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.568532 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.568779 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.568888 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.569042 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.569142 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.569347 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.569447 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.569652 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.569759 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.569958 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.570057 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.570267 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.570361 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.570570 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.570671 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.570874 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.570967 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.571178 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.571269 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.571481 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.571583 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.572344 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.572496 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.572625 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.572739 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.572943 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.573059 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.573171 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.573310 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.573310 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.573734 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.573857 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.573969 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.574081 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.574198 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.574309 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.574426 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.574546 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.574667 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.574786 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.574898 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.575008 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.575117 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.575235 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.575347 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.575494 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.575615 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.575828 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.575970 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.576143 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.576262 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.576499 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.576633 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.576789 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.576928 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.577100 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.577220 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.577417 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.577550 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.577748 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.577881 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.578077 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.578196 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.578386 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.578733 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.578872 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.579046 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.579186 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.579372 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.579522 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.579845 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.579961 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.580040 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.580193 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.580338 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.580530 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.580651 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.580856 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.580956 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.581176 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.581271 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.581517 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.581610 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.581841 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.581937 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.582155 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.582248 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.582467 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.582570 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.582782 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.582883 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.583098 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.583191 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.583410 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.583522 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.583822 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.583954 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.584092 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.584191 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.584402 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.584500 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.584727 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.584829 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.585052 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.585159 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.585381 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.585476 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.585698 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.585796 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.586015 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.586120 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.586355 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.586448 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.586674 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.586766 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.586987 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.587092 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.587294 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.587395 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.587537 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 01:10:46.587654 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.588100 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.588392 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.588711 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.589031 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.589382 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.589705 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.590042 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.590377 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.590695 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.591030 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.591669 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.592325 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.592698 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.593056 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.593400 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.593734 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.594057 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.594373 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 01:10:46.594625 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 01:10:46.652580 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO dbcounter [None req-1f4aac2a-16cc-4999-afb0-c5aa7d750c22 None None] Registered counter for database nova_api Sep 06 01:10:46.662521 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO dbcounter [None req-fe7b8edc-c21f-45c5-8e71-17c5ff08463e None None] Registered counter for database nova_api Sep 06 01:10:46.673344 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_db.sqlalchemy.engines [None req-1f4aac2a-16cc-4999-afb0-c5aa7d750c22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120581) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 01:10:46.679887 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writer thread running {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 01:10:46.683623 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_db.sqlalchemy.engines [None req-fe7b8edc-c21f-45c5-8e71-17c5ff08463e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120580) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 01:10:46.690349 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writer thread running {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 01:10:46.736067 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.context [None req-1f4aac2a-16cc-4999-afb0-c5aa7d750c22 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),aad59874-72ec-4cb0-bd6c-f8599f20aa58(cell1) {{(pid=120581) load_cells /opt/stack/nova/nova/context.py:464}} Sep 06 01:10:46.740117 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f4aac2a-16cc-4999-afb0-c5aa7d750c22 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:10:46.740598 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f4aac2a-16cc-4999-afb0-c5aa7d750c22 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:10:46.742167 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f4aac2a-16cc-4999-afb0-c5aa7d750c22 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:10:46.742912 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f4aac2a-16cc-4999-afb0-c5aa7d750c22 None None] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:10:46.743359 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f4aac2a-16cc-4999-afb0-c5aa7d750c22 None None] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:10:46.745366 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f4aac2a-16cc-4999-afb0-c5aa7d750c22 None None] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:10:46.746636 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.context [None req-fe7b8edc-c21f-45c5-8e71-17c5ff08463e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),aad59874-72ec-4cb0-bd6c-f8599f20aa58(cell1) {{(pid=120580) load_cells /opt/stack/nova/nova/context.py:464}} Sep 06 01:10:46.747981 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO dbcounter [None req-1f4aac2a-16cc-4999-afb0-c5aa7d750c22 None None] Registered counter for database nova_cell0 Sep 06 01:10:46.750647 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fe7b8edc-c21f-45c5-8e71-17c5ff08463e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:10:46.751131 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fe7b8edc-c21f-45c5-8e71-17c5ff08463e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:10:46.751987 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO dbcounter [None req-1f4aac2a-16cc-4999-afb0-c5aa7d750c22 None None] Registered counter for database nova_cell1 Sep 06 01:10:46.752752 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fe7b8edc-c21f-45c5-8e71-17c5ff08463e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:10:46.753499 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fe7b8edc-c21f-45c5-8e71-17c5ff08463e None None] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:10:46.753952 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fe7b8edc-c21f-45c5-8e71-17c5ff08463e None None] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:10:46.755995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fe7b8edc-c21f-45c5-8e71-17c5ff08463e None None] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:10:46.758026 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO dbcounter [None req-fe7b8edc-c21f-45c5-8e71-17c5ff08463e None None] Registered counter for database nova_cell0 Sep 06 01:10:46.759059 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_db.sqlalchemy.engines [None req-1f4aac2a-16cc-4999-afb0-c5aa7d750c22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120581) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 01:10:46.760306 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_db.sqlalchemy.engines [None req-1f4aac2a-16cc-4999-afb0-c5aa7d750c22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120581) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 01:10:46.762196 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO dbcounter [None req-fe7b8edc-c21f-45c5-8e71-17c5ff08463e None None] Registered counter for database nova_cell1 Sep 06 01:10:46.766387 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writer thread running {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 01:10:46.769279 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_db.sqlalchemy.engines [None req-fe7b8edc-c21f-45c5-8e71-17c5ff08463e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120580) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 01:10:46.771558 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_db.sqlalchemy.engines [None req-fe7b8edc-c21f-45c5-8e71-17c5ff08463e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120580) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 01:10:46.771696 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writer thread running {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 01:10:46.776619 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writer thread running {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 01:10:46.779156 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writer thread running {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 01:10:46.914911 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO dbcounter [None req-1f4aac2a-16cc-4999-afb0-c5aa7d750c22 None None] Registered counter for database nova_cell0 Sep 06 01:10:46.923546 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_db.sqlalchemy.engines [None req-1f4aac2a-16cc-4999-afb0-c5aa7d750c22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120581) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 01:10:46.928271 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writer thread running {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 01:10:46.928683 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO dbcounter [None req-fe7b8edc-c21f-45c5-8e71-17c5ff08463e None None] Registered counter for database nova_cell0 Sep 06 01:10:46.937499 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_db.sqlalchemy.engines [None req-fe7b8edc-c21f-45c5-8e71-17c5ff08463e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120580) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 01:10:46.942183 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writer thread running {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 01:10:47.255903 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: WARNING keystonemiddleware.auth_token [None req-1f4aac2a-16cc-4999-afb0-c5aa7d750c22 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 01:10:47.263817 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: WARNING keystonemiddleware.auth_token [None req-1f4aac2a-16cc-4999-afb0-c5aa7d750c22 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 01:10:47.269314 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: WARNING keystonemiddleware.auth_token [None req-fe7b8edc-c21f-45c5-8e71-17c5ff08463e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 01:10:47.276618 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: WARNING keystonemiddleware.auth_token [None req-fe7b8edc-c21f-45c5-8e71-17c5ff08463e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 01:10:47.615725 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: WARNING keystonemiddleware.auth_token [None req-1f4aac2a-16cc-4999-afb0-c5aa7d750c22 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 01:10:47.622359 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: WARNING keystonemiddleware.auth_token [None req-1f4aac2a-16cc-4999-afb0-c5aa7d750c22 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 01:10:47.626587 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: WARNING keystonemiddleware.auth_token [None req-fe7b8edc-c21f-45c5-8e71-17c5ff08463e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 01:10:47.627680 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f711d7a9c0 pid: 120581 (default app) Sep 06 01:10:47.632677 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: WARNING keystonemiddleware.auth_token [None req-fe7b8edc-c21f-45c5-8e71-17c5ff08463e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 01:10:47.639093 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f711d7a9c0 pid: 120580 (default app) Sep 06 01:11:23.915526 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:11:23.916761 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:11:23.917745 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:11:23.919614 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:11:25.214697 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-85bbdbb8-b67e-49b9-8c62-8ce3d7de1294 tempest-VolumesTestJSON-1172013147 tempest-VolumesTestJSON-1172013147-project] Calling method '.version_select at 0x7fb06f1da3a0>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:25.246956 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_api:SELECT=3 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:11:25.247886 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell0:SELECT=3 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:11:25.248731 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell1:SELECT=3 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:11:25.249670 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell0:SELECT=3 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:11:25.876370 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-36eff564-e827-4ffe-adad-0b2df74d2b8f tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] Action: 'create', calling method: .version_select at 0x7fb06f132280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1785372602"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:11:26.467030 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-85bbdbb8-b67e-49b9-8c62-8ce3d7de1294 tempest-VolumesTestJSON-1172013147 tempest-VolumesTestJSON-1172013147-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/d6216287-2f53-468b-94c5-a151daeaa2cf" status: 200 len: 350 microversion: 2.1 time: 1.786089 Sep 06 01:11:26.467619 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 1/1] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Sep 6 01:11:24 2022] GET /compute/v2.1/os-volumes/d6216287-2f53-468b-94c5-a151daeaa2cf => generated 350 bytes in 1788 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 01:11:27.796250 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-36eff564-e827-4ffe-adad-0b2df74d2b8f tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.896743 Sep 06 01:11:27.796905 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1/2] 10.222.0.23 () {60 vars in 1155 bytes} [Tue Sep 6 01:11:23 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3899 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 06 01:11:27.814614 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-25d82e28-2e21-45b1-a5f3-9551e2f227a4 tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] Calling method '.version_select at 0x7fb06eff21f0>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:28.076372 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-25d82e28-2e21-45b1-a5f3-9551e2f227a4 tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/ec0136de-6b3b-4b60-8c2e-b3f38dd92c46" status: 200 len: 345 microversion: 2.1 time: 0.265955 Sep 06 01:11:28.077348 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 2/3] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Sep 6 01:11:27 2022] GET /compute/v2.1/os-volumes/ec0136de-6b3b-4b60-8c2e-b3f38dd92c46 => generated 345 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:11:28.443726 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-09003858-d579-4919-a0f9-07e2bd7b90cd tempest-VolumesTestJSON-1172013147 tempest-VolumesTestJSON-1172013147-project] Calling method '.version_select at 0x7fb06f012160>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:28.548107 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-09003858-d579-4919-a0f9-07e2bd7b90cd tempest-VolumesTestJSON-1172013147 tempest-VolumesTestJSON-1172013147-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/057c8c10-f275-4d73-b57b-e9cad080a20a" status: 200 len: 351 microversion: 2.1 time: 0.108657 Sep 06 01:11:28.549525 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Sep 6 01:11:28 2022] GET /compute/v2.1/os-volumes/057c8c10-f275-4d73-b57b-e9cad080a20a => generated 351 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:11:29.091283 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-72c17940-5f1a-4e3b-bce4-ee3605269461 tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] Calling method '.version_select at 0x7fb06eff23a0>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:29.215841 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-72c17940-5f1a-4e3b-bce4-ee3605269461 tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/ec0136de-6b3b-4b60-8c2e-b3f38dd92c46" status: 200 len: 346 microversion: 2.1 time: 0.129303 Sep 06 01:11:29.216395 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 3/5] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Sep 6 01:11:29 2022] GET /compute/v2.1/os-volumes/ec0136de-6b3b-4b60-8c2e-b3f38dd92c46 => generated 346 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:11:29.229535 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0c2c020f-3fc7-41f5-be2e-17a554f1e192 tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] Action: 'create', calling method: .version_select at 0x7fb06f012820>, body: {"snapshot": {"volume_id": "ec0136de-6b3b-4b60-8c2e-b3f38dd92c46", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1194902229"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:11:29.676704 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0c2c020f-3fc7-41f5-be2e-17a554f1e192 tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] 10.222.0.23 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.451253 Sep 06 01:11:29.684957 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3/6] 10.222.0.23 () {60 vars in 1162 bytes} [Tue Sep 6 01:11:29 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:11:29.691263 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-51e6f08f-71c6-4c8f-876c-ab242bae20bd tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] Calling method '.version_select at 0x7fb06eff29d0>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:29.776502 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-51e6f08f-71c6-4c8f-876c-ab242bae20bd tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/adc35aa3-ddeb-42ee-9fae-fe1dbc56d423" status: 200 len: 287 microversion: 2.1 time: 0.090534 Sep 06 01:11:29.778103 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 4/7] 10.222.0.23 () {58 vars in 1251 bytes} [Tue Sep 6 01:11:29 2022] GET /compute/v2.1/os-snapshots/adc35aa3-ddeb-42ee-9fae-fe1dbc56d423 => generated 287 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:11:29.790477 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-aa5724d4-ea5f-4272-8b8c-960a111bc298 tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] Calling method '.version_select at 0x7fb06ef9d9d0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:29.850743 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-aa5724d4-ea5f-4272-8b8c-960a111bc298 tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.065359 Sep 06 01:11:29.851802 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1140 bytes} [Tue Sep 6 01:11:29 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:11:29.862764 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-8d81e5bc-e8fe-4f9e-94b1-0e646c314c3c tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] Calling method '.version_select at 0x7fb06effc040>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:29.896188 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-8d81e5bc-e8fe-4f9e-94b1-0e646c314c3c tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/adc35aa3-ddeb-42ee-9fae-fe1dbc56d423" status: 200 len: 287 microversion: 2.1 time: 0.037125 Sep 06 01:11:29.897059 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 5/9] 10.222.0.23 () {58 vars in 1251 bytes} [Tue Sep 6 01:11:29 2022] GET /compute/v2.1/os-snapshots/adc35aa3-ddeb-42ee-9fae-fe1dbc56d423 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 01:11:30.299976 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8134fb3b-49c5-4f6a-a12f-a4d149861420 tempest-VolumesTestJSON-1172013147 tempest-VolumesTestJSON-1172013147-project] Calling method '.version_select at 0x7fb06f012dc0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:30.384142 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8134fb3b-49c5-4f6a-a12f-a4d149861420 tempest-VolumesTestJSON-1172013147 tempest-VolumesTestJSON-1172013147-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/4d3ed592-624b-4774-bfc2-acea2631d070" status: 200 len: 351 microversion: 2.1 time: 0.090641 Sep 06 01:11:30.385225 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 5/10] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Sep 6 01:11:30 2022] GET /compute/v2.1/os-volumes/4d3ed592-624b-4774-bfc2-acea2631d070 => generated 351 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:11:30.412023 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-18d083f4-9c79-40a9-b655-20153bda0a67 tempest-VolumesTestJSON-1172013147 tempest-VolumesTestJSON-1172013147-project] Calling method '.version_select at 0x7fb06eff2dc0>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:30.648121 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-18d083f4-9c79-40a9-b655-20153bda0a67 tempest-VolumesTestJSON-1172013147 tempest-VolumesTestJSON-1172013147-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.250633 Sep 06 01:11:30.649109 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 6/11] 10.222.0.23 () {58 vars in 1134 bytes} [Tue Sep 6 01:11:30 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:11:30.682833 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e32f6120-b897-4f20-99e3-7cc1fe8ad224 tempest-VolumesTestJSON-1172013147 tempest-VolumesTestJSON-1172013147-project] Calling method '.version_select at 0x7fb06f012670>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:30.908623 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-cb38c4d8-3b42-4668-ba5b-ea7725f08c01 tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] Calling method '.version_select at 0x7fb06eff2700>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:30.984369 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e32f6120-b897-4f20-99e3-7cc1fe8ad224 tempest-VolumesTestJSON-1172013147 tempest-VolumesTestJSON-1172013147-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.319166 Sep 06 01:11:30.985112 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 6/12] 10.222.0.23 () {58 vars in 1149 bytes} [Tue Sep 6 01:11:30 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:11:31.003922 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d932e3f7-f73b-4789-9e95-3a441274f815 tempest-VolumesTestJSON-1172013147 tempest-VolumesTestJSON-1172013147-project] Calling method '.version_select at 0x7fb06efa1af0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:31.081327 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-cb38c4d8-3b42-4668-ba5b-ea7725f08c01 tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/adc35aa3-ddeb-42ee-9fae-fe1dbc56d423" status: 200 len: 287 microversion: 2.1 time: 0.176610 Sep 06 01:11:31.082378 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 7/13] 10.222.0.23 () {58 vars in 1251 bytes} [Tue Sep 6 01:11:30 2022] GET /compute/v2.1/os-snapshots/adc35aa3-ddeb-42ee-9fae-fe1dbc56d423 => generated 287 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:11:31.341182 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d932e3f7-f73b-4789-9e95-3a441274f815 tempest-VolumesTestJSON-1172013147 tempest-VolumesTestJSON-1172013147-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.343353 Sep 06 01:11:31.342136 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 7/14] 10.222.0.23 () {58 vars in 1134 bytes} [Tue Sep 6 01:11:30 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:11:31.357169 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-b933e431-63d2-41d4-80ee-98eabf2800c1 tempest-VolumesTestJSON-1172013147 tempest-VolumesTestJSON-1172013147-project] Calling method '.version_select at 0x7fb06eff2f70>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:31.674250 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-b933e431-63d2-41d4-80ee-98eabf2800c1 tempest-VolumesTestJSON-1172013147 tempest-VolumesTestJSON-1172013147-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.322616 Sep 06 01:11:31.683848 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 8/15] 10.222.0.23 () {58 vars in 1167 bytes} [Tue Sep 6 01:11:31 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:11:31.692595 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-eac2dd51-87b5-4d5d-af08-09a292dbd46e tempest-VolumesTestJSON-1172013147 tempest-VolumesTestJSON-1172013147-project] Calling method '.version_select at 0x7fb06f012d30>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:31.909808 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-eac2dd51-87b5-4d5d-af08-09a292dbd46e tempest-VolumesTestJSON-1172013147 tempest-VolumesTestJSON-1172013147-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.220960 Sep 06 01:11:31.911226 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 8/16] 10.222.0.23 () {58 vars in 1170 bytes} [Tue Sep 6 01:11:31 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:11:31.945581 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-f74ccb24-a67b-49ed-ad8e-73a9932535dd tempest-VolumesTestJSON-1172013147 tempest-VolumesTestJSON-1172013147-project] Calling method '.version_select at 0x7fb06effcd30>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:32.095057 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-124a4762-f83a-4444-bd2d-87bdbd745718 tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] Calling method '.version_select at 0x7fb06efa4430>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:32.109090 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-f74ccb24-a67b-49ed-ad8e-73a9932535dd tempest-VolumesTestJSON-1172013147 tempest-VolumesTestJSON-1172013147-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.184468 Sep 06 01:11:32.120000 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 9/17] 10.222.0.23 () {58 vars in 1155 bytes} [Tue Sep 6 01:11:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:11:32.128890 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-c581d7f1-118d-44e9-9506-81f0007a2ec2 tempest-VolumesTestJSON-1172013147 tempest-VolumesTestJSON-1172013147-project] Calling method '.version_select at 0x7fb06effc820>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:32.171282 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-124a4762-f83a-4444-bd2d-87bdbd745718 tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/adc35aa3-ddeb-42ee-9fae-fe1dbc56d423" status: 200 len: 287 microversion: 2.1 time: 0.079540 Sep 06 01:11:32.172457 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 9/18] 10.222.0.23 () {58 vars in 1251 bytes} [Tue Sep 6 01:11:32 2022] GET /compute/v2.1/os-snapshots/adc35aa3-ddeb-42ee-9fae-fe1dbc56d423 => generated 287 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:11:32.324396 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-c581d7f1-118d-44e9-9506-81f0007a2ec2 tempest-VolumesTestJSON-1172013147 tempest-VolumesTestJSON-1172013147-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.199759 Sep 06 01:11:32.326253 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 10/19] 10.222.0.23 () {58 vars in 1188 bytes} [Tue Sep 6 01:11:32 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 01:11:32.340673 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-78cb553a-6a70-430a-aaf7-f7b3334f568f tempest-VolumesTestJSON-1172013147 tempest-VolumesTestJSON-1172013147-project] Calling method '.version_select at 0x7fb06efa4af0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:32.512830 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-78cb553a-6a70-430a-aaf7-f7b3334f568f tempest-VolumesTestJSON-1172013147 tempest-VolumesTestJSON-1172013147-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.177539 Sep 06 01:11:32.513387 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 10/20] 10.222.0.23 () {58 vars in 1155 bytes} [Tue Sep 6 01:11:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:11:33.187381 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-2486153b-64cf-454a-b0f8-9e82e4fa5f41 tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] Calling method '.version_select at 0x7fb06eff2820>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:33.255690 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-2486153b-64cf-454a-b0f8-9e82e4fa5f41 tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/adc35aa3-ddeb-42ee-9fae-fe1dbc56d423" status: 200 len: 288 microversion: 2.1 time: 0.074146 Sep 06 01:11:33.256586 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 11/21] 10.222.0.23 () {58 vars in 1251 bytes} [Tue Sep 6 01:11:33 2022] GET /compute/v2.1/os-snapshots/adc35aa3-ddeb-42ee-9fae-fe1dbc56d423 => generated 288 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:11:33.268623 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-443daf9b-8760-4e34-95a4-8429b5b548ce tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] Calling method '.version_select at 0x7fb06efa4a60>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:33.427802 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-443daf9b-8760-4e34-95a4-8429b5b548ce tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] 10.222.0.23 "DELETE /compute/v2.1/os-snapshots/adc35aa3-ddeb-42ee-9fae-fe1dbc56d423" status: 202 len: 0 microversion: 2.1 time: 0.162735 Sep 06 01:11:33.428926 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 11/22] 10.222.0.23 () {58 vars in 1254 bytes} [Tue Sep 6 01:11:33 2022] DELETE /compute/v2.1/os-snapshots/adc35aa3-ddeb-42ee-9fae-fe1dbc56d423 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 01:11:33.441633 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-bb0932a2-3c57-41af-8b31-706e5073f5b5 tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] Calling method '.version_select at 0x7fb06ef9bb80>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:33.548757 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-bb0932a2-3c57-41af-8b31-706e5073f5b5 tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/adc35aa3-ddeb-42ee-9fae-fe1dbc56d423" status: 200 len: 287 microversion: 2.1 time: 0.114799 Sep 06 01:11:33.550140 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 12/23] 10.222.0.23 () {58 vars in 1251 bytes} [Tue Sep 6 01:11:33 2022] GET /compute/v2.1/os-snapshots/adc35aa3-ddeb-42ee-9fae-fe1dbc56d423 => generated 287 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:11:34.563659 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4661e747-02ea-43fc-838d-818e2b17a063 tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] Calling method '.version_select at 0x7fb06efa4310>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:34.619076 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-4661e747-02ea-43fc-838d-818e2b17a063 tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] HTTP exception thrown: Snapshot adc35aa3-ddeb-42ee-9fae-fe1dbc56d423 could not be found. Sep 06 01:11:34.624428 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4661e747-02ea-43fc-838d-818e2b17a063 tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] Request method failure captured: Sep 06 01:11:34.624428 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: request: GET /compute/v2.1/os-snapshots/adc35aa3-ddeb-42ee-9fae-fe1dbc56d423 HTTP/1.1 Sep 06 01:11:34.624428 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept: application/json Sep 06 01:11:34.624428 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept-Encoding: identity Sep 06 01:11:34.624428 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Connection: close Sep 06 01:11:34.624428 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Length: 0 Sep 06 01:11:34.624428 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Type: application/json Sep 06 01:11:34.624428 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Host: 10.222.0.23 Sep 06 01:11:34.624428 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Openstack-System-Scope: None Sep 06 01:11:34.624428 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Sep 06 01:11:34.624428 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjFp47GP9UZCelgLA7AzKCFY4uHye58bUxUm296MMDaEu3rSrruRnE1VgIGsI5HyqmsiH-cydF0t0OZZ-wgkWE4E7TQFKdvb_nbyAQE0YbBzDO-S8qqZx4TU0WiE2uqljzbr3HXOt8iCFVwrc8nAknH62shwkKQOzu1A1LVTkYLWUQDik Sep 06 01:11:34.624428 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Id: None Sep 06 01:11:34.624428 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Name: None Sep 06 01:11:34.624428 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Identity-Status: Confirmed Sep 06 01:11:34.624428 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Is-Admin-Project: True Sep 06 01:11:34.624428 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Id: default Sep 06 01:11:34.624428 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Name: Default Sep 06 01:11:34.624428 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Id: 157fb4225c2546c2895715756c36d70c Sep 06 01:11:34.624428 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1280014766 Sep 06 01:11:34.624428 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Role: reader,member Sep 06 01:11:34.624428 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Roles: reader,member Sep 06 01:11:34.625744 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/157fb4225c2546c2895715756c36d70c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/157fb4225c2546c2895715756c36d70c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_157fb4225c2546c2895715756c36d70c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/157fb4225c2546c2895715756c36d70c"}]}] Sep 06 01:11:34.625744 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1280014766 Sep 06 01:11:34.625744 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Id: 157fb4225c2546c2895715756c36d70c Sep 06 01:11:34.625744 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1280014766 Sep 06 01:11:34.625744 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User: tempest-VolumesSnapshotsTestJSON-1280014766-project Sep 06 01:11:34.625744 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Id: default Sep 06 01:11:34.625744 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Name: Default Sep 06 01:11:34.625744 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Id: a7cbf89bdd8c4e0e9be7ac5f8567538d Sep 06 01:11:34.625744 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1280014766-project Sep 06 01:11:34.625744 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: method: Sep 06 01:11:34.625744 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: exception: Snapshot adc35aa3-ddeb-42ee-9fae-fe1dbc56d423 could not be found. Sep 06 01:11:34.625744 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: action_args: {'id': 'adc35aa3-ddeb-42ee-9fae-fe1dbc56d423'} Sep 06 01:11:34.625744 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:11:34.626508 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:11:34.626508 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 06 01:11:34.626508 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 06 01:11:34.626508 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 06 01:11:34.626508 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 06 01:11:34.626508 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 06 01:11:34.626508 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 06 01:11:34.626508 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 01:11:34.626508 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 01:11:34.626508 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 01:11:34.626508 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 01:11:34.626508 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 01:11:34.626508 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 01:11:34.626508 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 01:11:34.626508 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 01:11:34.626508 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot adc35aa3-ddeb-42ee-9fae-fe1dbc56d423 could not be found. (HTTP 404) (Request-ID: req-cabef658-0dcf-42c8-aa20-d886c1e64d34) Sep 06 01:11:34.626508 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:11:34.626508 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:11:34.627511 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:11:34.627511 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:11:34.627511 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 06 01:11:34.627511 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 06 01:11:34.627511 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 01:11:34.627511 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 01:11:34.627511 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 06 01:11:34.627511 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 06 01:11:34.627511 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 01:11:34.627511 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 01:11:34.627511 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 06 01:11:34.627511 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 06 01:11:34.627511 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 06 01:11:34.627511 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 06 01:11:34.627511 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 06 01:11:34.627511 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 06 01:11:34.627511 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 01:11:34.627511 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 01:11:34.627511 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 01:11:34.628646 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 01:11:34.628646 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 01:11:34.628646 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 01:11:34.628646 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 01:11:34.628646 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 01:11:34.628646 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot adc35aa3-ddeb-42ee-9fae-fe1dbc56d423 could not be found. Sep 06 01:11:34.628646 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:11:34.628646 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:11:34.628646 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:11:34.628646 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:11:34.628646 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:11:34.628646 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:11:34.628646 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:11:34.628646 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:11:34.628646 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 01:11:34.628646 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 01:11:34.628646 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:11:34.628646 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:11:34.628646 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 06 01:11:34.628646 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:11:34.629731 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot adc35aa3-ddeb-42ee-9fae-fe1dbc56d423 could not be found. Sep 06 01:11:34.629731 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:11:34.629731 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:11:34.629731 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:11:34.629731 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:11:34.629731 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:11:34.629731 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:11:34.629731 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:11:34.629731 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:11:34.629731 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot adc35aa3-ddeb-42ee-9fae-fe1dbc56d423 could not be found. Sep 06 01:11:34.629731 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:11:34.632274 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4661e747-02ea-43fc-838d-818e2b17a063 tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] Returning 404 to user: Snapshot adc35aa3-ddeb-42ee-9fae-fe1dbc56d423 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:11:34.633741 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4661e747-02ea-43fc-838d-818e2b17a063 tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/adc35aa3-ddeb-42ee-9fae-fe1dbc56d423" status: 404 len: 111 microversion: 2.1 time: 0.074782 Sep 06 01:11:34.635958 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 12/24] 10.222.0.23 () {58 vars in 1251 bytes} [Tue Sep 6 01:11:34 2022] GET /compute/v2.1/os-snapshots/adc35aa3-ddeb-42ee-9fae-fe1dbc56d423 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 01:11:34.643368 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-7a513248-f9c5-4ddf-aef1-69f8a8c35957 tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] Calling method '.version_select at 0x7fb06eff21f0>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:34.778033 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-7a513248-f9c5-4ddf-aef1-69f8a8c35957 tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/ec0136de-6b3b-4b60-8c2e-b3f38dd92c46" status: 202 len: 0 microversion: 2.1 time: 0.139285 Sep 06 01:11:34.779247 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 13/25] 10.222.0.23 () {58 vars in 1248 bytes} [Tue Sep 6 01:11:34 2022] DELETE /compute/v2.1/os-volumes/ec0136de-6b3b-4b60-8c2e-b3f38dd92c46 => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 01:11:34.787833 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f41d7799-f589-4121-a7d0-5ff3017b4594 tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] Calling method '.version_select at 0x7fb06f012e50>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:34.945834 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f41d7799-f589-4121-a7d0-5ff3017b4594 tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/ec0136de-6b3b-4b60-8c2e-b3f38dd92c46" status: 200 len: 345 microversion: 2.1 time: 0.162610 Sep 06 01:11:34.947782 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 13/26] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Sep 6 01:11:34 2022] GET /compute/v2.1/os-volumes/ec0136de-6b3b-4b60-8c2e-b3f38dd92c46 => generated 345 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:11:35.965924 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-15de5df2-e085-42df-8156-0d8617bc0038 tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] Calling method '.version_select at 0x7fb06eff2d30>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:36.037492 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.wsgi [None req-15de5df2-e085-42df-8156-0d8617bc0038 tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] HTTP exception thrown: Volume ec0136de-6b3b-4b60-8c2e-b3f38dd92c46 could not be found. Sep 06 01:11:36.042006 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-15de5df2-e085-42df-8156-0d8617bc0038 tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] Request method failure captured: Sep 06 01:11:36.042006 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: request: GET /compute/v2.1/os-volumes/ec0136de-6b3b-4b60-8c2e-b3f38dd92c46 HTTP/1.1 Sep 06 01:11:36.042006 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept: application/json Sep 06 01:11:36.042006 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept-Encoding: identity Sep 06 01:11:36.042006 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Connection: close Sep 06 01:11:36.042006 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Length: 0 Sep 06 01:11:36.042006 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Type: application/json Sep 06 01:11:36.042006 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Host: 10.222.0.23 Sep 06 01:11:36.042006 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Openstack-System-Scope: None Sep 06 01:11:36.042006 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: User-Agent: python-urllib3/1.26.12 Sep 06 01:11:36.042006 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Auth-Token: gAAAAABjFp47GP9UZCelgLA7AzKCFY4uHye58bUxUm296MMDaEu3rSrruRnE1VgIGsI5HyqmsiH-cydF0t0OZZ-wgkWE4E7TQFKdvb_nbyAQE0YbBzDO-S8qqZx4TU0WiE2uqljzbr3HXOt8iCFVwrc8nAknH62shwkKQOzu1A1LVTkYLWUQDik Sep 06 01:11:36.042006 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Id: None Sep 06 01:11:36.042006 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Name: None Sep 06 01:11:36.042006 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Identity-Status: Confirmed Sep 06 01:11:36.042006 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Is-Admin-Project: True Sep 06 01:11:36.042006 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Id: default Sep 06 01:11:36.042006 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Name: Default Sep 06 01:11:36.042006 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Id: 157fb4225c2546c2895715756c36d70c Sep 06 01:11:36.042006 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1280014766 Sep 06 01:11:36.042006 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Role: reader,member Sep 06 01:11:36.042006 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Roles: reader,member Sep 06 01:11:36.043029 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/157fb4225c2546c2895715756c36d70c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/157fb4225c2546c2895715756c36d70c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_157fb4225c2546c2895715756c36d70c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/157fb4225c2546c2895715756c36d70c"}]}] Sep 06 01:11:36.043029 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1280014766 Sep 06 01:11:36.043029 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Id: 157fb4225c2546c2895715756c36d70c Sep 06 01:11:36.043029 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1280014766 Sep 06 01:11:36.043029 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User: tempest-VolumesSnapshotsTestJSON-1280014766-project Sep 06 01:11:36.043029 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Id: default Sep 06 01:11:36.043029 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Name: Default Sep 06 01:11:36.043029 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Id: a7cbf89bdd8c4e0e9be7ac5f8567538d Sep 06 01:11:36.043029 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1280014766-project Sep 06 01:11:36.043029 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: method: Sep 06 01:11:36.043029 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: exception: Volume ec0136de-6b3b-4b60-8c2e-b3f38dd92c46 could not be found. Sep 06 01:11:36.043029 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: action_args: {'id': 'ec0136de-6b3b-4b60-8c2e-b3f38dd92c46'} Sep 06 01:11:36.043029 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:11:36.044445 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:11:36.044445 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 01:11:36.044445 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 01:11:36.044445 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 01:11:36.044445 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 01:11:36.044445 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 01:11:36.044445 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 01:11:36.044445 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 01:11:36.044445 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 01:11:36.044445 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 01:11:36.044445 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 01:11:36.044445 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 01:11:36.044445 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 01:11:36.044445 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 01:11:36.044445 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 01:11:36.044445 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ec0136de-6b3b-4b60-8c2e-b3f38dd92c46 could not be found. (HTTP 404) (Request-ID: req-d2a58a2b-6d59-4a79-bc46-a41bee0b1b56) Sep 06 01:11:36.044445 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:11:36.044445 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:11:36.044445 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:11:36.045293 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:11:36.045293 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 06 01:11:36.045293 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 06 01:11:36.045293 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 01:11:36.045293 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 01:11:36.045293 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 01:11:36.045293 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 01:11:36.045293 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 01:11:36.045293 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 01:11:36.045293 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 01:11:36.045293 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 01:11:36.045293 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 01:11:36.045293 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 01:11:36.045293 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 01:11:36.045293 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 01:11:36.045293 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 01:11:36.045293 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 01:11:36.045293 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 01:11:36.045293 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 01:11:36.046376 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 01:11:36.046376 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 01:11:36.046376 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 01:11:36.046376 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 01:11:36.046376 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ec0136de-6b3b-4b60-8c2e-b3f38dd92c46 could not be found. Sep 06 01:11:36.046376 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:11:36.046376 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:11:36.046376 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:11:36.046376 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:11:36.046376 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:11:36.046376 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:11:36.046376 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:11:36.046376 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:11:36.046376 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 01:11:36.046376 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 01:11:36.046376 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:11:36.046376 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:11:36.046376 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 06 01:11:36.046376 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:11:36.047402 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ec0136de-6b3b-4b60-8c2e-b3f38dd92c46 could not be found. Sep 06 01:11:36.047402 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:11:36.047402 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:11:36.047402 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:11:36.047402 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:11:36.047402 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:11:36.047402 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:11:36.047402 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:11:36.047402 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:11:36.047402 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ec0136de-6b3b-4b60-8c2e-b3f38dd92c46 could not be found. Sep 06 01:11:36.047402 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:11:36.052143 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-15de5df2-e085-42df-8156-0d8617bc0038 tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] Returning 404 to user: Volume ec0136de-6b3b-4b60-8c2e-b3f38dd92c46 could not be found. {{(pid=120580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:11:36.053190 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-15de5df2-e085-42df-8156-0d8617bc0038 tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/ec0136de-6b3b-4b60-8c2e-b3f38dd92c46" status: 404 len: 109 microversion: 2.1 time: 0.094540 Sep 06 01:11:36.064601 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 14/27] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Sep 6 01:11:35 2022] GET /compute/v2.1/os-volumes/ec0136de-6b3b-4b60-8c2e-b3f38dd92c46 => generated 109 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 01:11:36.069595 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-63bd05f2-1597-4f9d-83ef-72327bbd3477 tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] Calling method '.version_select at 0x7fb06f012700>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:36.117196 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-63bd05f2-1597-4f9d-83ef-72327bbd3477 tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] HTTP exception thrown: Volume ec0136de-6b3b-4b60-8c2e-b3f38dd92c46 could not be found. Sep 06 01:11:36.120312 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-63bd05f2-1597-4f9d-83ef-72327bbd3477 tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] Request method failure captured: Sep 06 01:11:36.120312 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: request: DELETE /compute/v2.1/os-volumes/ec0136de-6b3b-4b60-8c2e-b3f38dd92c46 HTTP/1.1 Sep 06 01:11:36.120312 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept: application/json Sep 06 01:11:36.120312 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept-Encoding: identity Sep 06 01:11:36.120312 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Connection: close Sep 06 01:11:36.120312 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Length: 0 Sep 06 01:11:36.120312 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Type: application/json Sep 06 01:11:36.120312 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Host: 10.222.0.23 Sep 06 01:11:36.120312 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Openstack-System-Scope: None Sep 06 01:11:36.120312 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Sep 06 01:11:36.120312 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjFp47GP9UZCelgLA7AzKCFY4uHye58bUxUm296MMDaEu3rSrruRnE1VgIGsI5HyqmsiH-cydF0t0OZZ-wgkWE4E7TQFKdvb_nbyAQE0YbBzDO-S8qqZx4TU0WiE2uqljzbr3HXOt8iCFVwrc8nAknH62shwkKQOzu1A1LVTkYLWUQDik Sep 06 01:11:36.120312 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Id: None Sep 06 01:11:36.120312 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Name: None Sep 06 01:11:36.120312 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Identity-Status: Confirmed Sep 06 01:11:36.120312 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Is-Admin-Project: True Sep 06 01:11:36.120312 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Id: default Sep 06 01:11:36.120312 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Name: Default Sep 06 01:11:36.120312 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Id: 157fb4225c2546c2895715756c36d70c Sep 06 01:11:36.120312 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1280014766 Sep 06 01:11:36.120312 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Role: reader,member Sep 06 01:11:36.120312 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Roles: reader,member Sep 06 01:11:36.121456 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/157fb4225c2546c2895715756c36d70c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/157fb4225c2546c2895715756c36d70c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_157fb4225c2546c2895715756c36d70c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/157fb4225c2546c2895715756c36d70c"}]}] Sep 06 01:11:36.121456 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1280014766 Sep 06 01:11:36.121456 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Id: 157fb4225c2546c2895715756c36d70c Sep 06 01:11:36.121456 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1280014766 Sep 06 01:11:36.121456 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User: tempest-VolumesSnapshotsTestJSON-1280014766-project Sep 06 01:11:36.121456 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Id: default Sep 06 01:11:36.121456 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Name: Default Sep 06 01:11:36.121456 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Id: a7cbf89bdd8c4e0e9be7ac5f8567538d Sep 06 01:11:36.121456 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1280014766-project Sep 06 01:11:36.121456 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: method: Sep 06 01:11:36.121456 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: exception: Volume ec0136de-6b3b-4b60-8c2e-b3f38dd92c46 could not be found. Sep 06 01:11:36.121456 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: action_args: {'id': 'ec0136de-6b3b-4b60-8c2e-b3f38dd92c46'} Sep 06 01:11:36.121456 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:11:36.122049 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:11:36.122049 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 01:11:36.122049 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 01:11:36.122049 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 01:11:36.122049 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 01:11:36.122049 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 01:11:36.122049 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 01:11:36.122049 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 01:11:36.122049 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 01:11:36.122049 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 01:11:36.122049 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 01:11:36.122049 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 01:11:36.122049 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 01:11:36.122049 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 01:11:36.122049 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 01:11:36.122049 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ec0136de-6b3b-4b60-8c2e-b3f38dd92c46 could not be found. (HTTP 404) (Request-ID: req-f5fa68fc-a5d3-4b50-9945-f8b72b5c0b3a) Sep 06 01:11:36.122049 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:11:36.122049 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:11:36.122049 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:11:36.122983 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:11:36.122983 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 06 01:11:36.122983 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 06 01:11:36.122983 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 01:11:36.122983 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 01:11:36.122983 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 01:11:36.122983 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 01:11:36.122983 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 01:11:36.122983 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 01:11:36.122983 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 01:11:36.122983 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 01:11:36.122983 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 01:11:36.122983 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 01:11:36.122983 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 01:11:36.122983 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 01:11:36.122983 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 01:11:36.122983 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 01:11:36.122983 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 01:11:36.122983 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 01:11:36.123872 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 01:11:36.123872 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 01:11:36.123872 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 01:11:36.123872 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 01:11:36.123872 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ec0136de-6b3b-4b60-8c2e-b3f38dd92c46 could not be found. Sep 06 01:11:36.123872 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:11:36.123872 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:11:36.123872 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:11:36.123872 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:11:36.123872 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:11:36.123872 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:11:36.123872 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:11:36.123872 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:11:36.123872 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 01:11:36.123872 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 01:11:36.123872 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:11:36.123872 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:11:36.123872 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 06 01:11:36.123872 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:11:36.124725 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ec0136de-6b3b-4b60-8c2e-b3f38dd92c46 could not be found. Sep 06 01:11:36.124725 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:11:36.124725 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:11:36.124725 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:11:36.124725 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:11:36.124725 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:11:36.124725 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:11:36.124725 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:11:36.124725 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:11:36.124725 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ec0136de-6b3b-4b60-8c2e-b3f38dd92c46 could not be found. Sep 06 01:11:36.124725 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:11:36.127338 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-63bd05f2-1597-4f9d-83ef-72327bbd3477 tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] Returning 404 to user: Volume ec0136de-6b3b-4b60-8c2e-b3f38dd92c46 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:11:36.129351 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-63bd05f2-1597-4f9d-83ef-72327bbd3477 tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/ec0136de-6b3b-4b60-8c2e-b3f38dd92c46" status: 404 len: 109 microversion: 2.1 time: 0.064339 Sep 06 01:11:36.130322 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 14/28] 10.222.0.23 () {58 vars in 1248 bytes} [Tue Sep 6 01:11:36 2022] DELETE /compute/v2.1/os-volumes/ec0136de-6b3b-4b60-8c2e-b3f38dd92c46 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 01:11:36.139253 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-7e557e0e-97ed-473a-acfd-034c5feb9c1b tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] Calling method '.version_select at 0x7fb06effc670>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:36.183834 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.wsgi [None req-7e557e0e-97ed-473a-acfd-034c5feb9c1b tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] HTTP exception thrown: Volume ec0136de-6b3b-4b60-8c2e-b3f38dd92c46 could not be found. Sep 06 01:11:36.186292 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-7e557e0e-97ed-473a-acfd-034c5feb9c1b tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] Request method failure captured: Sep 06 01:11:36.186292 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: request: GET /compute/v2.1/os-volumes/ec0136de-6b3b-4b60-8c2e-b3f38dd92c46 HTTP/1.1 Sep 06 01:11:36.186292 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept: application/json Sep 06 01:11:36.186292 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept-Encoding: identity Sep 06 01:11:36.186292 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Connection: close Sep 06 01:11:36.186292 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Length: 0 Sep 06 01:11:36.186292 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Type: application/json Sep 06 01:11:36.186292 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Host: 10.222.0.23 Sep 06 01:11:36.186292 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Openstack-System-Scope: None Sep 06 01:11:36.186292 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: User-Agent: python-urllib3/1.26.12 Sep 06 01:11:36.186292 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Auth-Token: gAAAAABjFp47GP9UZCelgLA7AzKCFY4uHye58bUxUm296MMDaEu3rSrruRnE1VgIGsI5HyqmsiH-cydF0t0OZZ-wgkWE4E7TQFKdvb_nbyAQE0YbBzDO-S8qqZx4TU0WiE2uqljzbr3HXOt8iCFVwrc8nAknH62shwkKQOzu1A1LVTkYLWUQDik Sep 06 01:11:36.186292 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Id: None Sep 06 01:11:36.186292 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Name: None Sep 06 01:11:36.186292 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Identity-Status: Confirmed Sep 06 01:11:36.186292 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Is-Admin-Project: True Sep 06 01:11:36.186292 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Id: default Sep 06 01:11:36.186292 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Name: Default Sep 06 01:11:36.186292 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Id: 157fb4225c2546c2895715756c36d70c Sep 06 01:11:36.186292 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1280014766 Sep 06 01:11:36.186292 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Role: reader,member Sep 06 01:11:36.186292 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Roles: reader,member Sep 06 01:11:36.187311 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/157fb4225c2546c2895715756c36d70c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/157fb4225c2546c2895715756c36d70c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_157fb4225c2546c2895715756c36d70c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/157fb4225c2546c2895715756c36d70c"}]}] Sep 06 01:11:36.187311 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1280014766 Sep 06 01:11:36.187311 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Id: 157fb4225c2546c2895715756c36d70c Sep 06 01:11:36.187311 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1280014766 Sep 06 01:11:36.187311 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User: tempest-VolumesSnapshotsTestJSON-1280014766-project Sep 06 01:11:36.187311 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Id: default Sep 06 01:11:36.187311 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Name: Default Sep 06 01:11:36.187311 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Id: a7cbf89bdd8c4e0e9be7ac5f8567538d Sep 06 01:11:36.187311 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1280014766-project Sep 06 01:11:36.187311 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: method: Sep 06 01:11:36.187311 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: exception: Volume ec0136de-6b3b-4b60-8c2e-b3f38dd92c46 could not be found. Sep 06 01:11:36.187311 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: action_args: {'id': 'ec0136de-6b3b-4b60-8c2e-b3f38dd92c46'} Sep 06 01:11:36.187311 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:11:36.187947 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:11:36.187947 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 01:11:36.187947 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 01:11:36.187947 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 01:11:36.187947 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 01:11:36.187947 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 01:11:36.187947 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 01:11:36.187947 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 01:11:36.187947 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 01:11:36.187947 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 01:11:36.187947 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 01:11:36.187947 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 01:11:36.187947 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 01:11:36.187947 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 01:11:36.187947 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 01:11:36.187947 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ec0136de-6b3b-4b60-8c2e-b3f38dd92c46 could not be found. (HTTP 404) (Request-ID: req-dfcbedc3-8080-421e-bf23-cd2813a51798) Sep 06 01:11:36.187947 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:11:36.187947 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:11:36.187947 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:11:36.188819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:11:36.188819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 06 01:11:36.188819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 06 01:11:36.188819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 01:11:36.188819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 01:11:36.188819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 01:11:36.188819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 01:11:36.188819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 01:11:36.188819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 01:11:36.188819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 01:11:36.188819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 01:11:36.188819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 01:11:36.188819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 01:11:36.188819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 01:11:36.188819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 01:11:36.188819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 01:11:36.188819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 01:11:36.188819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 01:11:36.188819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 01:11:36.190515 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 01:11:36.190515 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 01:11:36.190515 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 01:11:36.190515 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 01:11:36.190515 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ec0136de-6b3b-4b60-8c2e-b3f38dd92c46 could not be found. Sep 06 01:11:36.190515 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:11:36.190515 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:11:36.190515 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:11:36.190515 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:11:36.190515 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:11:36.190515 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:11:36.190515 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:11:36.190515 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:11:36.190515 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 01:11:36.190515 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 01:11:36.190515 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:11:36.190515 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:11:36.190515 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 06 01:11:36.190515 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:11:36.192734 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ec0136de-6b3b-4b60-8c2e-b3f38dd92c46 could not be found. Sep 06 01:11:36.192734 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:11:36.192734 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:11:36.192734 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:11:36.192734 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:11:36.192734 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:11:36.192734 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:11:36.192734 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:11:36.192734 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:11:36.192734 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ec0136de-6b3b-4b60-8c2e-b3f38dd92c46 could not be found. Sep 06 01:11:36.192734 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:11:36.192734 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-7e557e0e-97ed-473a-acfd-034c5feb9c1b tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] Returning 404 to user: Volume ec0136de-6b3b-4b60-8c2e-b3f38dd92c46 could not be found. {{(pid=120580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:11:36.192734 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-7e557e0e-97ed-473a-acfd-034c5feb9c1b tempest-VolumesSnapshotsTestJSON-1280014766 tempest-VolumesSnapshotsTestJSON-1280014766-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/ec0136de-6b3b-4b60-8c2e-b3f38dd92c46" status: 404 len: 109 microversion: 2.1 time: 0.053441 Sep 06 01:11:36.192734 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 15/29] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Sep 6 01:11:36 2022] GET /compute/v2.1/os-volumes/ec0136de-6b3b-4b60-8c2e-b3f38dd92c46 => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 01:11:36.643644 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6db5f6d8-bcf3-4734-bf2a-a5ebdba8d01f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Action: 'create', calling method: .version_select at 0x7fb06f0128b0>, body: {"keypair": {"name": "tempest-keypair-1187091458", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0Ctpbo9aymtrJ66lobSvUCttRz93Q8zEg7tbGhFurxftqdMDTWdV84nq3uija9vtvb7LVCYK7gHciqoC6ZC5V3jvTJrF3L1B0cMpJxhD+Q0gCBdRyCQ3/fYRnIQyXZxw=="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:11:36.786359 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.quota [None req-6db5f6d8-bcf3-4734-bf2a-a5ebdba8d01f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Getting quotas for project 1fa73b0bfee14a9ea25f03e523078995. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 01:11:36.806154 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.quota [None req-6db5f6d8-bcf3-4734-bf2a-a5ebdba8d01f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Getting quotas for user f8f44df824414e5ebc8cfd2126e9d66f and project 1fa73b0bfee14a9ea25f03e523078995. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 01:11:36.918866 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6db5f6d8-bcf3-4734-bf2a-a5ebdba8d01f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.761382 Sep 06 01:11:36.926676 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 15/30] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Sep 6 01:11:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 01:11:38.162567 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-0cbe62d4-2219-4c0d-89ce-8635b3cee439 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Action: 'create', calling method: .version_select at 0x7fb06effcc10>, body: {"keypair": {"name": "tempest-keypair-1466073252", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3WgZEFgkVJFnLJ7bs53y+/IgSNtM7QkZCdwAxlj/o7pursSH2Iz10pT4By769IMi81bMFKmHIcE69GX1l2N6ad8bhAdcKowErD7FTRGBThuMcEJKBCzL6RMUX67FVUBg=="}} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:11:38.313786 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.quota [None req-0cbe62d4-2219-4c0d-89ce-8635b3cee439 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Getting quotas for project 1c096a50088a4b8dbd00458b324f301e. Resources: {'key_pairs'} {{(pid=120580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 01:11:38.332782 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.quota [None req-0cbe62d4-2219-4c0d-89ce-8635b3cee439 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Getting quotas for user 2dc5c46544a447159b7fd3d225cd9697 and project 1c096a50088a4b8dbd00458b324f301e. Resources: {'key_pairs'} {{(pid=120580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 01:11:38.475022 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-0cbe62d4-2219-4c0d-89ce-8635b3cee439 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.988179 Sep 06 01:11:38.492147 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 16/31] 10.222.0.23 () {62 vars in 1200 bytes} [Tue Sep 6 01:11:37 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1006 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 06 01:11:42.273164 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3ea53b38-06bd-4cfb-8952-20872ece9672 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-408798549", "imageRef": "768973cc-7b5f-4eed-b493-e40eb0de9f88", "flavorRef": "452", "networks": [{"uuid": "b7baa9ac-e73b-4f98-8f2e-e06584b465e3"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:11:42.492444 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-3ea53b38-06bd-4cfb-8952-20872ece9672 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] validate_networks() for [('b7baa9ac-e73b-4f98-8f2e-e06584b465e3', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 01:11:42.542271 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-e92682b0-4ba6-46f2-9013-9cebf6cb3956 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-29132497", "imageRef": "768973cc-7b5f-4eed-b493-e40eb0de9f88", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:11:42.720974 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.network.neutron [None req-e92682b0-4ba6-46f2-9013-9cebf6cb3956 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] validate_networks() for [('d22ca9da-097a-4693-98a0-43d03128776e', None, None, None, None, None)] {{(pid=120580) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 01:11:44.684969 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-3ea53b38-06bd-4cfb-8952-20872ece9672 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 01:11:44.685512 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-3ea53b38-06bd-4cfb-8952-20872ece9672 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 01:11:44.685855 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-3ea53b38-06bd-4cfb-8952-20872ece9672 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 01:11:44.686365 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-3ea53b38-06bd-4cfb-8952-20872ece9672 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 01:11:44.687193 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-3ea53b38-06bd-4cfb-8952-20872ece9672 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 01:11:44.716215 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ea53b38-06bd-4cfb-8952-20872ece9672 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:44.718305 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ea53b38-06bd-4cfb-8952-20872ece9672 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:44.719889 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ea53b38-06bd-4cfb-8952-20872ece9672 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:44.724020 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ea53b38-06bd-4cfb-8952-20872ece9672 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:44.729439 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ea53b38-06bd-4cfb-8952-20872ece9672 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:44.733998 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ea53b38-06bd-4cfb-8952-20872ece9672 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:44.817663 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-e92682b0-4ba6-46f2-9013-9cebf6cb3956 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Flavor limits 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 01:11:44.818137 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-e92682b0-4ba6-46f2-9013-9cebf6cb3956 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Image limits 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 01:11:44.818554 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-e92682b0-4ba6-46f2-9013-9cebf6cb3956 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Flavor pref 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 01:11:44.818980 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-e92682b0-4ba6-46f2-9013-9cebf6cb3956 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Image pref 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 01:11:44.819377 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-e92682b0-4ba6-46f2-9013-9cebf6cb3956 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 01:11:44.820087 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.quota [None req-3ea53b38-06bd-4cfb-8952-20872ece9672 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Getting quotas for project 2002558f3d814b1b892ca2d22ff25f05. Resources: {'instances', 'ram', 'cores'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 01:11:44.839323 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.quota [None req-3ea53b38-06bd-4cfb-8952-20872ece9672 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Getting quotas for user 0354d80eb898418fae8acf8baf4894b1 and project 2002558f3d814b1b892ca2d22ff25f05. Resources: {'instances', 'ram', 'cores'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 01:11:44.850622 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e92682b0-4ba6-46f2-9013-9cebf6cb3956 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:44.851115 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e92682b0-4ba6-46f2-9013-9cebf6cb3956 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:44.851557 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e92682b0-4ba6-46f2-9013-9cebf6cb3956 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:44.852338 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e92682b0-4ba6-46f2-9013-9cebf6cb3956 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:44.853421 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e92682b0-4ba6-46f2-9013-9cebf6cb3956 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:44.853846 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e92682b0-4ba6-46f2-9013-9cebf6cb3956 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:44.874929 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3ea53b38-06bd-4cfb-8952-20872ece9672 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 01:11:44.893356 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3ea53b38-06bd-4cfb-8952-20872ece9672 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] [instance: e19b4dae-fc30-4e15-ad48-d3892ce81801] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='768973cc-7b5f-4eed-b493-e40eb0de9f88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 01:11:44.938690 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.quota [None req-e92682b0-4ba6-46f2-9013-9cebf6cb3956 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Getting quotas for project 91ee5ad0b4064b9d8a038980786072cb. Resources: {'instances', 'ram', 'cores'} {{(pid=120580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 01:11:44.953340 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.quota [None req-e92682b0-4ba6-46f2-9013-9cebf6cb3956 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Getting quotas for user 703464e4a9524efaa8fdfc1870158cbb and project 91ee5ad0b4064b9d8a038980786072cb. Resources: {'instances', 'ram', 'cores'} {{(pid=120580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 01:11:44.998077 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-e92682b0-4ba6-46f2-9013-9cebf6cb3956 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Going to run 1 instances... {{(pid=120580) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 01:11:45.005296 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-e92682b0-4ba6-46f2-9013-9cebf6cb3956 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='768973cc-7b5f-4eed-b493-e40eb0de9f88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 01:11:45.081571 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3ea53b38-06bd-4cfb-8952-20872ece9672 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.733954 Sep 06 01:11:45.083227 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 16/32] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Sep 6 01:11:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 3736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 01:11:45.095682 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1f5fe517-bb97-4ce4-b934-3687e787dc6d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1814342157", "imageRef": "768973cc-7b5f-4eed-b493-e40eb0de9f88", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d10b81f4-8ccb-48ae-aa86-1440cea903cc"}], "security_groups": [{"name": "tempest-securitygroup--1441382160"}], "key_name": "tempest-keypair-1187091458", "user_data": "}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:11:45.208986 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-e92682b0-4ba6-46f2-9013-9cebf6cb3956 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.832396 Sep 06 01:11:45.221996 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 17/33] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Sep 6 01:11:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 2848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 01:11:45.277812 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-404088c3-fa12-46a1-9284-1834f23e2230 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1327511914", "imageRef": "768973cc-7b5f-4eed-b493-e40eb0de9f88", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f028d99a-9873-49ec-abeb-029461c8fb87"}], "security_groups": [{"name": "tempest-securitygroup--1271964650"}], "key_name": "tempest-keypair-1466073252", "user_data": "}} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:11:45.678631 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-1f5fe517-bb97-4ce4-b934-3687e787dc6d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] validate_networks() for [('d10b81f4-8ccb-48ae-aa86-1440cea903cc', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 01:11:45.869553 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.network.neutron [None req-404088c3-fa12-46a1-9284-1834f23e2230 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] validate_networks() for [('f028d99a-9873-49ec-abeb-029461c8fb87', None, None, None, None, None)] {{(pid=120580) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 01:11:47.247003 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-1f5fe517-bb97-4ce4-b934-3687e787dc6d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 01:11:47.248018 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-1f5fe517-bb97-4ce4-b934-3687e787dc6d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 01:11:47.248651 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-1f5fe517-bb97-4ce4-b934-3687e787dc6d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 01:11:47.249214 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-1f5fe517-bb97-4ce4-b934-3687e787dc6d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 01:11:47.249781 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-1f5fe517-bb97-4ce4-b934-3687e787dc6d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 01:11:47.282465 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f5fe517-bb97-4ce4-b934-3687e787dc6d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:47.282964 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f5fe517-bb97-4ce4-b934-3687e787dc6d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:47.283410 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f5fe517-bb97-4ce4-b934-3687e787dc6d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:47.284171 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f5fe517-bb97-4ce4-b934-3687e787dc6d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:47.284631 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f5fe517-bb97-4ce4-b934-3687e787dc6d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:47.285060 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f5fe517-bb97-4ce4-b934-3687e787dc6d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:47.372623 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.quota [None req-1f5fe517-bb97-4ce4-b934-3687e787dc6d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Getting quotas for project 1fa73b0bfee14a9ea25f03e523078995. Resources: {'instances', 'ram', 'cores'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 01:11:47.421074 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.quota [None req-1f5fe517-bb97-4ce4-b934-3687e787dc6d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Getting quotas for user f8f44df824414e5ebc8cfd2126e9d66f and project 1fa73b0bfee14a9ea25f03e523078995. Resources: {'instances', 'ram', 'cores'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 01:11:47.469820 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1f5fe517-bb97-4ce4-b934-3687e787dc6d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 01:11:47.472054 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1f5fe517-bb97-4ce4-b934-3687e787dc6d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='768973cc-7b5f-4eed-b493-e40eb0de9f88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 01:11:47.609420 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1f5fe517-bb97-4ce4-b934-3687e787dc6d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.524703 Sep 06 01:11:47.612540 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 17/34] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Sep 6 01:11:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 2529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 01:11:47.625014 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3536f604-dc4b-4eae-840f-4b38e40623bd tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:47.631275 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3536f604-dc4b-4eae-840f-4b38e40623bd tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] [instance: e19b4dae-fc30-4e15-ad48-d3892ce81801] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:11:47.662195 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3536f604-dc4b-4eae-840f-4b38e40623bd tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:47.663944 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3536f604-dc4b-4eae-840f-4b38e40623bd tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:47.666006 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3536f604-dc4b-4eae-840f-4b38e40623bd tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:47.668336 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3536f604-dc4b-4eae-840f-4b38e40623bd tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:47.670097 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3536f604-dc4b-4eae-840f-4b38e40623bd tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:47.670883 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3536f604-dc4b-4eae-840f-4b38e40623bd tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:47.701080 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-404088c3-fa12-46a1-9284-1834f23e2230 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Flavor limits 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 01:11:47.702391 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-404088c3-fa12-46a1-9284-1834f23e2230 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Image limits 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 01:11:47.703228 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-404088c3-fa12-46a1-9284-1834f23e2230 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Flavor pref 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 01:11:47.703662 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-404088c3-fa12-46a1-9284-1834f23e2230 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Image pref 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 01:11:47.704140 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-404088c3-fa12-46a1-9284-1834f23e2230 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 01:11:47.734331 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-404088c3-fa12-46a1-9284-1834f23e2230 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:47.734914 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-404088c3-fa12-46a1-9284-1834f23e2230 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:47.742003 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-404088c3-fa12-46a1-9284-1834f23e2230 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:47.744914 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-404088c3-fa12-46a1-9284-1834f23e2230 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:47.748550 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-404088c3-fa12-46a1-9284-1834f23e2230 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:47.750515 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-404088c3-fa12-46a1-9284-1834f23e2230 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:47.837271 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.quota [None req-404088c3-fa12-46a1-9284-1834f23e2230 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Getting quotas for project 1c096a50088a4b8dbd00458b324f301e. Resources: {'instances', 'ram', 'cores'} {{(pid=120580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 01:11:47.854374 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.quota [None req-404088c3-fa12-46a1-9284-1834f23e2230 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Getting quotas for user 2dc5c46544a447159b7fd3d225cd9697 and project 1c096a50088a4b8dbd00458b324f301e. Resources: {'instances', 'ram', 'cores'} {{(pid=120580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 01:11:47.901057 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-404088c3-fa12-46a1-9284-1834f23e2230 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Going to run 1 instances... {{(pid=120580) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 01:11:47.903240 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-404088c3-fa12-46a1-9284-1834f23e2230 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='768973cc-7b5f-4eed-b493-e40eb0de9f88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 01:11:48.055330 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-404088c3-fa12-46a1-9284-1834f23e2230 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.831779 Sep 06 01:11:48.058046 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 18/35] 10.222.0.23 () {62 vars in 1188 bytes} [Tue Sep 6 01:11:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 2835 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 06 01:11:48.068956 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-f9223ac2-ebb8-437a-ab43-b8ff3564fe40 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:48.075709 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-f9223ac2-ebb8-437a-ab43-b8ff3564fe40 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:11:48.438585 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-3536f604-dc4b-4eae-840f-4b38e40623bd tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0354d80eb898418fae8acf8baf4894b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2002558f3d814b1b892ca2d22ff25f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:11:48.514498 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3536f604-dc4b-4eae-840f-4b38e40623bd tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] 10.222.0.23 "GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801" status: 200 len: 1218 microversion: 2.1 time: 0.882311 Sep 06 01:11:48.524114 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 18/36] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:11:47 2022] GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801 => generated 1218 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:11:48.529918 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-413cde8b-a830-46aa-ae55-eb576e2e443f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:48.530756 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-413cde8b-a830-46aa-ae55-eb576e2e443f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:11:48.567936 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-f9223ac2-ebb8-437a-ab43-b8ff3564fe40 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:11:48.623042 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-f9223ac2-ebb8-437a-ab43-b8ff3564fe40 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1220 microversion: 2.1 time: 0.561553 Sep 06 01:11:48.633084 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 19/37] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:11:48 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1220 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:11:48.645224 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-f53f9050-616a-44de-8a1a-a70e6b01036e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:48.645840 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-f53f9050-616a-44de-8a1a-a70e6b01036e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:11:48.678552 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-413cde8b-a830-46aa-ae55-eb576e2e443f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:11:48.726953 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-413cde8b-a830-46aa-ae55-eb576e2e443f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e" status: 200 len: 1242 microversion: 2.1 time: 0.199942 Sep 06 01:11:48.729011 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 19/38] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:11:48 2022] GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e => generated 1242 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:11:48.863616 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-f53f9050-616a-44de-8a1a-a70e6b01036e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:11:48.891488 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-f53f9050-616a-44de-8a1a-a70e6b01036e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:11:48.897916 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-f53f9050-616a-44de-8a1a-a70e6b01036e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:11:48.899120 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-f53f9050-616a-44de-8a1a-a70e6b01036e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1282 microversion: 2.20 time: 0.258275 Sep 06 01:11:48.917394 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 20/39] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:11:48 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1282 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:11:49.303603 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d7257141-c703-4701-9172-c86d67a890ba tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2127566974", "imageRef": "768973cc-7b5f-4eed-b493-e40eb0de9f88", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:11:49.440029 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-d7257141-c703-4701-9172-c86d67a890ba tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] validate_networks() for [('d22ca9da-097a-4693-98a0-43d03128776e', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 01:11:49.540212 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-f4b0318d-1b2e-413e-ad4e-2c962b154097 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:49.540943 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-f4b0318d-1b2e-413e-ad4e-2c962b154097 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] [instance: e19b4dae-fc30-4e15-ad48-d3892ce81801] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:11:49.550119 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f4b0318d-1b2e-413e-ad4e-2c962b154097 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:49.564564 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f4b0318d-1b2e-413e-ad4e-2c962b154097 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:49.565104 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f4b0318d-1b2e-413e-ad4e-2c962b154097 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:49.565917 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f4b0318d-1b2e-413e-ad4e-2c962b154097 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:49.566460 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f4b0318d-1b2e-413e-ad4e-2c962b154097 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:49.566962 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f4b0318d-1b2e-413e-ad4e-2c962b154097 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:50.110043 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-f4b0318d-1b2e-413e-ad4e-2c962b154097 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0354d80eb898418fae8acf8baf4894b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2002558f3d814b1b892ca2d22ff25f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:11:50.139426 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-f4b0318d-1b2e-413e-ad4e-2c962b154097 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] 10.222.0.23 "GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801" status: 200 len: 1274 microversion: 2.1 time: 0.602970 Sep 06 01:11:50.148238 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 21/40] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:11:49 2022] GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801 => generated 1274 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:11:50.177331 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-cb4f3ebc-83f5-4d4d-9be1-2148f44e6fc5 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:50.177980 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-cb4f3ebc-83f5-4d4d-9be1-2148f44e6fc5 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:11:50.224230 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cb4f3ebc-83f5-4d4d-9be1-2148f44e6fc5 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:50.224791 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cb4f3ebc-83f5-4d4d-9be1-2148f44e6fc5 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:50.225301 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cb4f3ebc-83f5-4d4d-9be1-2148f44e6fc5 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:50.226124 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cb4f3ebc-83f5-4d4d-9be1-2148f44e6fc5 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:50.227006 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cb4f3ebc-83f5-4d4d-9be1-2148f44e6fc5 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:50.234210 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cb4f3ebc-83f5-4d4d-9be1-2148f44e6fc5 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:50.591912 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-cb4f3ebc-83f5-4d4d-9be1-2148f44e6fc5 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:11:50.609676 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-cb4f3ebc-83f5-4d4d-9be1-2148f44e6fc5 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e" status: 200 len: 1294 microversion: 2.1 time: 0.460268 Sep 06 01:11:50.612333 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 22/41] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:11:50 2022] GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e => generated 1294 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:11:50.633932 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-bc6b7574-6f55-41f3-bbae-33e4cbd98342 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:50.636447 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-bc6b7574-6f55-41f3-bbae-33e4cbd98342 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:11:50.645308 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-bc6b7574-6f55-41f3-bbae-33e4cbd98342 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:50.645942 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-bc6b7574-6f55-41f3-bbae-33e4cbd98342 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:50.646380 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-bc6b7574-6f55-41f3-bbae-33e4cbd98342 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:50.647245 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-bc6b7574-6f55-41f3-bbae-33e4cbd98342 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:50.655642 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-bc6b7574-6f55-41f3-bbae-33e4cbd98342 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:50.656956 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-bc6b7574-6f55-41f3-bbae-33e4cbd98342 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:50.922449 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-bc6b7574-6f55-41f3-bbae-33e4cbd98342 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:11:50.941873 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-bc6b7574-6f55-41f3-bbae-33e4cbd98342 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:11:50.950158 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-bc6b7574-6f55-41f3-bbae-33e4cbd98342 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:11:50.955905 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-bc6b7574-6f55-41f3-bbae-33e4cbd98342 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1334 microversion: 2.20 time: 0.341385 Sep 06 01:11:50.959072 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 23/42] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:11:50 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1334 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:11:51.179923 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-009c3076-6f20-44f7-9f94-95b2923863b9 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:51.180891 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-009c3076-6f20-44f7-9f94-95b2923863b9 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] [instance: e19b4dae-fc30-4e15-ad48-d3892ce81801] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:11:51.208773 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-009c3076-6f20-44f7-9f94-95b2923863b9 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:51.211624 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-009c3076-6f20-44f7-9f94-95b2923863b9 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:51.222525 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-009c3076-6f20-44f7-9f94-95b2923863b9 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:51.223415 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-009c3076-6f20-44f7-9f94-95b2923863b9 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:51.225787 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-d7257141-c703-4701-9172-c86d67a890ba tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 01:11:51.227303 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-d7257141-c703-4701-9172-c86d67a890ba tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 01:11:51.227982 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-d7257141-c703-4701-9172-c86d67a890ba tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 01:11:51.228514 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-d7257141-c703-4701-9172-c86d67a890ba tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 01:11:51.229037 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-d7257141-c703-4701-9172-c86d67a890ba tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 01:11:51.231532 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-009c3076-6f20-44f7-9f94-95b2923863b9 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:51.237617 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-009c3076-6f20-44f7-9f94-95b2923863b9 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:51.252114 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d7257141-c703-4701-9172-c86d67a890ba tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:51.254863 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d7257141-c703-4701-9172-c86d67a890ba tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:51.256187 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d7257141-c703-4701-9172-c86d67a890ba tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:51.272003 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d7257141-c703-4701-9172-c86d67a890ba tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:51.273241 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d7257141-c703-4701-9172-c86d67a890ba tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:51.275385 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d7257141-c703-4701-9172-c86d67a890ba tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:51.348615 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.quota [None req-d7257141-c703-4701-9172-c86d67a890ba tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Getting quotas for project 91ee5ad0b4064b9d8a038980786072cb. Resources: {'instances', 'ram', 'cores'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 01:11:51.356729 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.quota [None req-d7257141-c703-4701-9172-c86d67a890ba tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Getting quotas for user 703464e4a9524efaa8fdfc1870158cbb and project 91ee5ad0b4064b9d8a038980786072cb. Resources: {'instances', 'ram', 'cores'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 01:11:51.389295 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d7257141-c703-4701-9172-c86d67a890ba tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 01:11:51.410331 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d7257141-c703-4701-9172-c86d67a890ba tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='768973cc-7b5f-4eed-b493-e40eb0de9f88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 01:11:51.532061 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d7257141-c703-4701-9172-c86d67a890ba tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.232687 Sep 06 01:11:51.533351 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 20/43] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Sep 6 01:11:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 2235 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 01:11:51.550116 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ff44113c-21ed-4794-ae15-4ef6943a131f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:51.552485 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ff44113c-21ed-4794-ae15-4ef6943a131f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:11:51.794772 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-009c3076-6f20-44f7-9f94-95b2923863b9 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0354d80eb898418fae8acf8baf4894b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2002558f3d814b1b892ca2d22ff25f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:11:51.802586 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-009c3076-6f20-44f7-9f94-95b2923863b9 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] 10.222.0.23 "GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801" status: 200 len: 1272 microversion: 2.1 time: 0.628596 Sep 06 01:11:51.808418 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 24/44] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:11:51 2022] GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801 => generated 1272 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:11:51.818845 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-cdc0165f-62ae-4898-90e2-f2cdb17eadb3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:51.819467 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-cdc0165f-62ae-4898-90e2-f2cdb17eadb3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:11:51.842293 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cdc0165f-62ae-4898-90e2-f2cdb17eadb3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:51.842903 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cdc0165f-62ae-4898-90e2-f2cdb17eadb3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:51.843226 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cdc0165f-62ae-4898-90e2-f2cdb17eadb3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:51.853185 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cdc0165f-62ae-4898-90e2-f2cdb17eadb3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:51.854815 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cdc0165f-62ae-4898-90e2-f2cdb17eadb3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:51.855265 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cdc0165f-62ae-4898-90e2-f2cdb17eadb3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:51.873388 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-ff44113c-21ed-4794-ae15-4ef6943a131f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:11:51.885219 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ff44113c-21ed-4794-ae15-4ef6943a131f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1222 microversion: 2.1 time: 0.343009 Sep 06 01:11:51.888512 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 21/45] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:11:51 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1222 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:11:52.005814 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a1438b7c-6ee5-43b3-bf5b-ae3cbc3e127b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:52.007102 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a1438b7c-6ee5-43b3-bf5b-ae3cbc3e127b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:11:52.034968 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a1438b7c-6ee5-43b3-bf5b-ae3cbc3e127b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:52.038986 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a1438b7c-6ee5-43b3-bf5b-ae3cbc3e127b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:52.042236 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a1438b7c-6ee5-43b3-bf5b-ae3cbc3e127b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:52.047228 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a1438b7c-6ee5-43b3-bf5b-ae3cbc3e127b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:52.047804 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a1438b7c-6ee5-43b3-bf5b-ae3cbc3e127b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:52.052642 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a1438b7c-6ee5-43b3-bf5b-ae3cbc3e127b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:52.238131 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-cdc0165f-62ae-4898-90e2-f2cdb17eadb3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:11:52.253342 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-cdc0165f-62ae-4898-90e2-f2cdb17eadb3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e" status: 200 len: 1300 microversion: 2.1 time: 0.442528 Sep 06 01:11:52.271240 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 25/46] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:11:51 2022] GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e => generated 1300 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:11:52.845104 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-040c0710-e7c7-4a7c-8358-8de4fcf30959 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:52.847216 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-040c0710-e7c7-4a7c-8358-8de4fcf30959 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] [instance: e19b4dae-fc30-4e15-ad48-d3892ce81801] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:11:52.857627 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-040c0710-e7c7-4a7c-8358-8de4fcf30959 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:52.859586 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-040c0710-e7c7-4a7c-8358-8de4fcf30959 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:52.860611 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-040c0710-e7c7-4a7c-8358-8de4fcf30959 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:52.862211 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-040c0710-e7c7-4a7c-8358-8de4fcf30959 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:52.863012 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-040c0710-e7c7-4a7c-8358-8de4fcf30959 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:52.864196 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-040c0710-e7c7-4a7c-8358-8de4fcf30959 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:53.116079 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-a1438b7c-6ee5-43b3-bf5b-ae3cbc3e127b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:11:53.116079 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-a1438b7c-6ee5-43b3-bf5b-ae3cbc3e127b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:11:53.117137 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-a1438b7c-6ee5-43b3-bf5b-ae3cbc3e127b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:11:53.128867 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a1438b7c-6ee5-43b3-bf5b-ae3cbc3e127b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1342 microversion: 2.20 time: 1.143474 Sep 06 01:11:53.147393 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 22/47] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:11:51 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1342 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:11:53.167853 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e84e5dda-d730-4619-8adb-84dc795d9c68 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:53.169096 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e84e5dda-d730-4619-8adb-84dc795d9c68 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:11:53.186995 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e84e5dda-d730-4619-8adb-84dc795d9c68 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:53.197061 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e84e5dda-d730-4619-8adb-84dc795d9c68 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:53.197765 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e84e5dda-d730-4619-8adb-84dc795d9c68 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:53.198678 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e84e5dda-d730-4619-8adb-84dc795d9c68 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:53.199280 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e84e5dda-d730-4619-8adb-84dc795d9c68 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:53.199908 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e84e5dda-d730-4619-8adb-84dc795d9c68 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:53.487463 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-040c0710-e7c7-4a7c-8358-8de4fcf30959 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0354d80eb898418fae8acf8baf4894b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2002558f3d814b1b892ca2d22ff25f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:11:53.489633 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-e84e5dda-d730-4619-8adb-84dc795d9c68 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:11:53.498727 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e84e5dda-d730-4619-8adb-84dc795d9c68 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1274 microversion: 2.1 time: 0.350883 Sep 06 01:11:53.499279 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-040c0710-e7c7-4a7c-8358-8de4fcf30959 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] 10.222.0.23 "GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801" status: 200 len: 1272 microversion: 2.1 time: 0.672318 Sep 06 01:11:53.511096 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 23/48] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:11:53 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1274 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:11:53.516992 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7c1d5f0e-3a6b-4510-a654-cb77ccdedd67 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:53.517608 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7c1d5f0e-3a6b-4510-a654-cb77ccdedd67 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:11:53.523443 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 26/49] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:11:52 2022] GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801 => generated 1272 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:11:53.533562 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c1d5f0e-3a6b-4510-a654-cb77ccdedd67 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:53.534059 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c1d5f0e-3a6b-4510-a654-cb77ccdedd67 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:53.534493 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c1d5f0e-3a6b-4510-a654-cb77ccdedd67 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:53.535192 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c1d5f0e-3a6b-4510-a654-cb77ccdedd67 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:53.535645 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c1d5f0e-3a6b-4510-a654-cb77ccdedd67 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:53.536092 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c1d5f0e-3a6b-4510-a654-cb77ccdedd67 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:54.159678 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-b72ef9f8-d494-489e-ad3c-d046e481d50c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:54.161006 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-b72ef9f8-d494-489e-ad3c-d046e481d50c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:11:54.181370 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b72ef9f8-d494-489e-ad3c-d046e481d50c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:54.187333 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b72ef9f8-d494-489e-ad3c-d046e481d50c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:54.189866 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b72ef9f8-d494-489e-ad3c-d046e481d50c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:54.193101 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b72ef9f8-d494-489e-ad3c-d046e481d50c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:54.201915 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b72ef9f8-d494-489e-ad3c-d046e481d50c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:54.203974 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b72ef9f8-d494-489e-ad3c-d046e481d50c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:54.584003 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-7c1d5f0e-3a6b-4510-a654-cb77ccdedd67 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:11:54.598703 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7c1d5f0e-3a6b-4510-a654-cb77ccdedd67 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e" status: 200 len: 1300 microversion: 2.1 time: 1.085067 Sep 06 01:11:54.600572 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 24/50] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:11:53 2022] GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e => generated 1300 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:11:54.614144 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-af954516-de09-48c0-a239-af2fad8c4cb3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:54.615167 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-af954516-de09-48c0-a239-af2fad8c4cb3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:11:54.630102 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-af954516-de09-48c0-a239-af2fad8c4cb3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:54.631847 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-af954516-de09-48c0-a239-af2fad8c4cb3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:54.634013 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-af954516-de09-48c0-a239-af2fad8c4cb3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:54.635157 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-af954516-de09-48c0-a239-af2fad8c4cb3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:54.638124 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-af954516-de09-48c0-a239-af2fad8c4cb3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:54.639064 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-af954516-de09-48c0-a239-af2fad8c4cb3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:54.832165 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-b72ef9f8-d494-489e-ad3c-d046e481d50c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:11:54.845011 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-b72ef9f8-d494-489e-ad3c-d046e481d50c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:11:54.863387 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-b72ef9f8-d494-489e-ad3c-d046e481d50c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:11:54.892262 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-b72ef9f8-d494-489e-ad3c-d046e481d50c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1340 microversion: 2.20 time: 0.736810 Sep 06 01:11:54.907943 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 27/51] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:11:54 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1340 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:11:54.924889 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-478b3483-d213-4e93-bf7f-827d2ed95895 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:54.928492 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-478b3483-d213-4e93-bf7f-827d2ed95895 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] [instance: e19b4dae-fc30-4e15-ad48-d3892ce81801] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:11:54.953360 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-478b3483-d213-4e93-bf7f-827d2ed95895 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:54.953859 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-478b3483-d213-4e93-bf7f-827d2ed95895 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:54.958779 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-478b3483-d213-4e93-bf7f-827d2ed95895 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:54.961318 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-478b3483-d213-4e93-bf7f-827d2ed95895 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:54.965612 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-478b3483-d213-4e93-bf7f-827d2ed95895 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:54.966237 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-478b3483-d213-4e93-bf7f-827d2ed95895 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:55.075407 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-af954516-de09-48c0-a239-af2fad8c4cb3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:11:55.095219 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-af954516-de09-48c0-a239-af2fad8c4cb3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1280 microversion: 2.1 time: 0.489485 Sep 06 01:11:55.098426 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 25/52] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:11:54 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1280 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:11:55.397502 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-478b3483-d213-4e93-bf7f-827d2ed95895 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0354d80eb898418fae8acf8baf4894b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2002558f3d814b1b892ca2d22ff25f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:11:55.408343 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-478b3483-d213-4e93-bf7f-827d2ed95895 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] 10.222.0.23 "GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801" status: 200 len: 1272 microversion: 2.1 time: 0.498595 Sep 06 01:11:55.415340 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 28/53] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:11:54 2022] GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801 => generated 1272 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:11:55.624007 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ca0f97d7-096f-48e3-8b17-23e82f79ccac tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:55.624646 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ca0f97d7-096f-48e3-8b17-23e82f79ccac tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:11:55.635928 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ca0f97d7-096f-48e3-8b17-23e82f79ccac tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:55.638650 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ca0f97d7-096f-48e3-8b17-23e82f79ccac tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:55.640673 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ca0f97d7-096f-48e3-8b17-23e82f79ccac tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:55.641677 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ca0f97d7-096f-48e3-8b17-23e82f79ccac tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:55.643000 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ca0f97d7-096f-48e3-8b17-23e82f79ccac tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:55.644846 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ca0f97d7-096f-48e3-8b17-23e82f79ccac tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:55.921522 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-4c8d1d7e-7150-4644-b50c-0350dc4590fe tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:55.922125 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-4c8d1d7e-7150-4644-b50c-0350dc4590fe tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:11:55.938355 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4c8d1d7e-7150-4644-b50c-0350dc4590fe tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:55.939171 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4c8d1d7e-7150-4644-b50c-0350dc4590fe tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:55.943892 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4c8d1d7e-7150-4644-b50c-0350dc4590fe tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:55.944877 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4c8d1d7e-7150-4644-b50c-0350dc4590fe tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:55.945556 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4c8d1d7e-7150-4644-b50c-0350dc4590fe tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:55.947696 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4c8d1d7e-7150-4644-b50c-0350dc4590fe tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:55.974814 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-ca0f97d7-096f-48e3-8b17-23e82f79ccac tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:11:56.032278 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ca0f97d7-096f-48e3-8b17-23e82f79ccac tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e" status: 200 len: 1300 microversion: 2.1 time: 0.410702 Sep 06 01:11:56.043200 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 26/54] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:11:55 2022] GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e => generated 1300 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:11:56.131678 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-75d88e54-feb4-49d4-9285-1a33172387b2 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:56.132337 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-75d88e54-feb4-49d4-9285-1a33172387b2 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:11:56.158114 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-75d88e54-feb4-49d4-9285-1a33172387b2 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:56.168029 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-75d88e54-feb4-49d4-9285-1a33172387b2 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:56.168793 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-75d88e54-feb4-49d4-9285-1a33172387b2 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:56.171460 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-75d88e54-feb4-49d4-9285-1a33172387b2 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:56.172108 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-75d88e54-feb4-49d4-9285-1a33172387b2 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:56.172462 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-75d88e54-feb4-49d4-9285-1a33172387b2 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:56.299242 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-4c8d1d7e-7150-4644-b50c-0350dc4590fe tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:11:56.313280 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-4c8d1d7e-7150-4644-b50c-0350dc4590fe tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:11:56.327333 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-4c8d1d7e-7150-4644-b50c-0350dc4590fe tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:11:56.329021 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-4c8d1d7e-7150-4644-b50c-0350dc4590fe tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1340 microversion: 2.20 time: 0.411930 Sep 06 01:11:56.333319 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 29/55] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:11:55 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1340 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:11:56.358073 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-75d88e54-feb4-49d4-9285-1a33172387b2 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:11:56.372443 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-75d88e54-feb4-49d4-9285-1a33172387b2 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1280 microversion: 2.1 time: 0.247511 Sep 06 01:11:56.384451 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 27/56] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:11:56 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1280 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:11:56.442824 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-9423e8e8-8bbd-4513-882d-9b5eb62d1d38 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:56.443648 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-9423e8e8-8bbd-4513-882d-9b5eb62d1d38 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] [instance: e19b4dae-fc30-4e15-ad48-d3892ce81801] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:11:56.454940 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9423e8e8-8bbd-4513-882d-9b5eb62d1d38 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:56.456283 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9423e8e8-8bbd-4513-882d-9b5eb62d1d38 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:56.459182 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9423e8e8-8bbd-4513-882d-9b5eb62d1d38 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:56.460819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9423e8e8-8bbd-4513-882d-9b5eb62d1d38 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:56.467041 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9423e8e8-8bbd-4513-882d-9b5eb62d1d38 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:56.468534 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9423e8e8-8bbd-4513-882d-9b5eb62d1d38 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:57.061889 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5a586948-8187-49ef-9df8-b2acc8530cb2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:57.069401 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5a586948-8187-49ef-9df8-b2acc8530cb2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:11:57.101153 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5a586948-8187-49ef-9df8-b2acc8530cb2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:57.104587 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5a586948-8187-49ef-9df8-b2acc8530cb2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:57.105232 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5a586948-8187-49ef-9df8-b2acc8530cb2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:57.106756 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5a586948-8187-49ef-9df8-b2acc8530cb2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:57.109562 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5a586948-8187-49ef-9df8-b2acc8530cb2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:57.119520 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5a586948-8187-49ef-9df8-b2acc8530cb2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:57.787580 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell0:SELECT=4 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:11:58.870592 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell0:SELECT=20 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:11:59.676343 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-9423e8e8-8bbd-4513-882d-9b5eb62d1d38 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0354d80eb898418fae8acf8baf4894b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2002558f3d814b1b892ca2d22ff25f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:11:59.695921 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-9423e8e8-8bbd-4513-882d-9b5eb62d1d38 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] 10.222.0.23 "GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801" status: 200 len: 1314 microversion: 2.1 time: 3.257349 Sep 06 01:11:59.702515 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 30/57] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:11:56 2022] GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801 => generated 1314 bytes in 3265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:11:59.712199 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-ec7dd698-3b04-445d-b46d-b6b49937c1e6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:59.716094 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-ec7dd698-3b04-445d-b46d-b6b49937c1e6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:11:59.733235 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ec7dd698-3b04-445d-b46d-b6b49937c1e6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:59.735195 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ec7dd698-3b04-445d-b46d-b6b49937c1e6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:59.735871 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ec7dd698-3b04-445d-b46d-b6b49937c1e6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:59.737661 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ec7dd698-3b04-445d-b46d-b6b49937c1e6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:59.738288 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ec7dd698-3b04-445d-b46d-b6b49937c1e6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:59.738883 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ec7dd698-3b04-445d-b46d-b6b49937c1e6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:59.741046 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-5a586948-8187-49ef-9df8-b2acc8530cb2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:11:59.750456 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5a586948-8187-49ef-9df8-b2acc8530cb2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e" status: 200 len: 1368 microversion: 2.1 time: 2.691565 Sep 06 01:11:59.751204 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 28/58] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:11:57 2022] GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e => generated 1368 bytes in 2694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:11:59.767740 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6be18e45-216e-42fa-93fe-da1bb74d9cf3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:11:59.768380 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6be18e45-216e-42fa-93fe-da1bb74d9cf3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:11:59.807026 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6be18e45-216e-42fa-93fe-da1bb74d9cf3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:59.807531 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6be18e45-216e-42fa-93fe-da1bb74d9cf3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:59.807991 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6be18e45-216e-42fa-93fe-da1bb74d9cf3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:11:59.808695 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6be18e45-216e-42fa-93fe-da1bb74d9cf3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:11:59.816856 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6be18e45-216e-42fa-93fe-da1bb74d9cf3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:11:59.817471 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6be18e45-216e-42fa-93fe-da1bb74d9cf3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:00.126249 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-ec7dd698-3b04-445d-b46d-b6b49937c1e6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:00.141538 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-ec7dd698-3b04-445d-b46d-b6b49937c1e6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:00.142994 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-ec7dd698-3b04-445d-b46d-b6b49937c1e6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:00.161571 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-ec7dd698-3b04-445d-b46d-b6b49937c1e6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1340 microversion: 2.20 time: 0.457619 Sep 06 01:12:00.169430 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 31/59] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:11:59 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1340 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:12:00.429145 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-6be18e45-216e-42fa-93fe-da1bb74d9cf3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:00.440541 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6be18e45-216e-42fa-93fe-da1bb74d9cf3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1280 microversion: 2.1 time: 0.686893 Sep 06 01:12:00.442091 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 29/60] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:11:59 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1280 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:00.627907 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-9d590853-5b1f-4768-a7cf-28a92e38a107 req-4160849a-43e9-4cfd-8ca5-dfaa17267292 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e19b4dae-fc30-4e15-ad48-d3892ce81801", "tag": "32b70eb8-cd96-473d-8902-5e15e8eae911"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:12:00.662824 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-9d590853-5b1f-4768-a7cf-28a92e38a107 req-4160849a-43e9-4cfd-8ca5-dfaa17267292 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:00.667577 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-9d590853-5b1f-4768-a7cf-28a92e38a107 req-4160849a-43e9-4cfd-8ca5-dfaa17267292 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:00.669320 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-9d590853-5b1f-4768-a7cf-28a92e38a107 req-4160849a-43e9-4cfd-8ca5-dfaa17267292 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:00.720515 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.compute.server_external_events [req-9d590853-5b1f-4768-a7cf-28a92e38a107 req-4160849a-43e9-4cfd-8ca5-dfaa17267292 service nova] Creating event network-changed:32b70eb8-cd96-473d-8902-5e15e8eae911 for instance e19b4dae-fc30-4e15-ad48-d3892ce81801 on hv-cinder-84773 Sep 06 01:12:00.722579 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-9d590853-5b1f-4768-a7cf-28a92e38a107 req-4160849a-43e9-4cfd-8ca5-dfaa17267292 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120580) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 06 01:12:00.731132 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5a2e250c-ac61-49cf-a3b3-5295cbdf7539 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:00.732216 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5a2e250c-ac61-49cf-a3b3-5295cbdf7539 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] [instance: e19b4dae-fc30-4e15-ad48-d3892ce81801] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:00.737396 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-9d590853-5b1f-4768-a7cf-28a92e38a107 req-4160849a-43e9-4cfd-8ca5-dfaa17267292 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120580) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 06 01:12:00.741095 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d28503b6-2ae2-4199-a8db-fb1875be54ec None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:00.747116 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d28503b6-2ae2-4199-a8db-fb1875be54ec None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:00.748267 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5a2e250c-ac61-49cf-a3b3-5295cbdf7539 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:00.749491 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d28503b6-2ae2-4199-a8db-fb1875be54ec None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:00.751203 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5a2e250c-ac61-49cf-a3b3-5295cbdf7539 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:00.752223 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d28503b6-2ae2-4199-a8db-fb1875be54ec None None] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:00.757734 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5a2e250c-ac61-49cf-a3b3-5295cbdf7539 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:00.758526 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d28503b6-2ae2-4199-a8db-fb1875be54ec None None] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:00.762051 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d28503b6-2ae2-4199-a8db-fb1875be54ec None None] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:00.762657 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5a2e250c-ac61-49cf-a3b3-5295cbdf7539 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:00.764680 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5a2e250c-ac61-49cf-a3b3-5295cbdf7539 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:00.767795 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5a2e250c-ac61-49cf-a3b3-5295cbdf7539 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:00.810331 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.compute.rpcapi [None req-d28503b6-2ae2-4199-a8db-fb1875be54ec None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 06 01:12:00.812344 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d28503b6-2ae2-4199-a8db-fb1875be54ec None None] Releasing lock "compute-rpcapi-router" {{(pid=120580) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 06 01:12:00.866390 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-d28503b6-2ae2-4199-a8db-fb1875be54ec None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.374760 Sep 06 01:12:00.870073 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 32/61] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:12:00.876566 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-f15d3313-9810-4ea3-8155-8203e19d6741 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:00.877531 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-f15d3313-9810-4ea3-8155-8203e19d6741 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:00.885155 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f15d3313-9810-4ea3-8155-8203e19d6741 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:00.886995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f15d3313-9810-4ea3-8155-8203e19d6741 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:00.887627 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f15d3313-9810-4ea3-8155-8203e19d6741 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:00.890365 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f15d3313-9810-4ea3-8155-8203e19d6741 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:00.891119 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f15d3313-9810-4ea3-8155-8203e19d6741 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:00.892880 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f15d3313-9810-4ea3-8155-8203e19d6741 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:01.320359 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:01.541679 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-5a2e250c-ac61-49cf-a3b3-5295cbdf7539 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0354d80eb898418fae8acf8baf4894b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2002558f3d814b1b892ca2d22ff25f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:01.562909 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5a2e250c-ac61-49cf-a3b3-5295cbdf7539 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] 10.222.0.23 "GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801" status: 200 len: 1314 microversion: 2.1 time: 0.837297 Sep 06 01:12:01.567816 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 30/62] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:00 2022] GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801 => generated 1314 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:01.590019 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-10468a0a-802d-473f-86ed-c8c9401ee7c8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:01.592296 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-10468a0a-802d-473f-86ed-c8c9401ee7c8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:01.622218 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10468a0a-802d-473f-86ed-c8c9401ee7c8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:01.624673 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10468a0a-802d-473f-86ed-c8c9401ee7c8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:01.628285 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10468a0a-802d-473f-86ed-c8c9401ee7c8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:01.630116 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10468a0a-802d-473f-86ed-c8c9401ee7c8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:01.631354 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10468a0a-802d-473f-86ed-c8c9401ee7c8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:01.632675 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10468a0a-802d-473f-86ed-c8c9401ee7c8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:01.879739 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=26 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:02.398832 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-f15d3313-9810-4ea3-8155-8203e19d6741 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:02.411260 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-f15d3313-9810-4ea3-8155-8203e19d6741 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e" status: 200 len: 1368 microversion: 2.1 time: 1.539330 Sep 06 01:12:02.415663 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 33/63] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:00 2022] GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e => generated 1368 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:02.432651 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-b19e53db-d25a-4a76-b8eb-270cfc016700 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:02.435227 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-b19e53db-d25a-4a76-b8eb-270cfc016700 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:02.450379 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b19e53db-d25a-4a76-b8eb-270cfc016700 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:02.450901 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b19e53db-d25a-4a76-b8eb-270cfc016700 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:02.452373 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b19e53db-d25a-4a76-b8eb-270cfc016700 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:02.453109 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b19e53db-d25a-4a76-b8eb-270cfc016700 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:02.453612 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b19e53db-d25a-4a76-b8eb-270cfc016700 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:02.458304 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b19e53db-d25a-4a76-b8eb-270cfc016700 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:02.560590 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-10468a0a-802d-473f-86ed-c8c9401ee7c8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:02.575576 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-10468a0a-802d-473f-86ed-c8c9401ee7c8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:02.577087 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-10468a0a-802d-473f-86ed-c8c9401ee7c8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:02.592843 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-10468a0a-802d-473f-86ed-c8c9401ee7c8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1408 microversion: 2.20 time: 1.023875 Sep 06 01:12:02.593931 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 31/64] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:12:01 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1408 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:12:02.604231 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-10d00ee0-29b5-4635-bf32-dbb4c6242758 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:02.610195 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-10d00ee0-29b5-4635-bf32-dbb4c6242758 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] [instance: e19b4dae-fc30-4e15-ad48-d3892ce81801] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:02.626106 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10d00ee0-29b5-4635-bf32-dbb4c6242758 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:02.629344 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10d00ee0-29b5-4635-bf32-dbb4c6242758 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:02.629984 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10d00ee0-29b5-4635-bf32-dbb4c6242758 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:02.631336 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10d00ee0-29b5-4635-bf32-dbb4c6242758 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:02.632800 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10d00ee0-29b5-4635-bf32-dbb4c6242758 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:02.634027 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10d00ee0-29b5-4635-bf32-dbb4c6242758 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:03.056909 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-b19e53db-d25a-4a76-b8eb-270cfc016700 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:03.067955 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-b19e53db-d25a-4a76-b8eb-270cfc016700 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1322 microversion: 2.1 time: 0.651071 Sep 06 01:12:03.068669 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 34/65] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:02 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1322 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:03.083502 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-83f9c6f1-ea26-4c45-a3b6-787244f844d0 req-650c0ab9-f857-44ab-b9d0-c17c92bff0ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf424d2a-0a95-48dc-9ee5-13fab569cb43", "tag": "c4540d59-8bd2-4cb6-a994-d575e41892b8"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:12:03.103640 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-83f9c6f1-ea26-4c45-a3b6-787244f844d0 req-650c0ab9-f857-44ab-b9d0-c17c92bff0ba service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:03.104143 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-83f9c6f1-ea26-4c45-a3b6-787244f844d0 req-650c0ab9-f857-44ab-b9d0-c17c92bff0ba service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:03.104619 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-83f9c6f1-ea26-4c45-a3b6-787244f844d0 req-650c0ab9-f857-44ab-b9d0-c17c92bff0ba service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:03.116820 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.compute.server_external_events [req-83f9c6f1-ea26-4c45-a3b6-787244f844d0 req-650c0ab9-f857-44ab-b9d0-c17c92bff0ba service nova] Creating event network-changed:c4540d59-8bd2-4cb6-a994-d575e41892b8 for instance cf424d2a-0a95-48dc-9ee5-13fab569cb43 on hv-cinder-84773 Sep 06 01:12:03.123304 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [req-83f9c6f1-ea26-4c45-a3b6-787244f844d0 req-650c0ab9-f857-44ab-b9d0-c17c92bff0ba service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045059 Sep 06 01:12:03.124864 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 35/66] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:12:03.437637 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-30e98675-8cb4-4b21-b94a-b4ed3ebe792f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:03.439211 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-30e98675-8cb4-4b21-b94a-b4ed3ebe792f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:03.454196 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-30e98675-8cb4-4b21-b94a-b4ed3ebe792f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:03.454953 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-30e98675-8cb4-4b21-b94a-b4ed3ebe792f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:03.455724 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-30e98675-8cb4-4b21-b94a-b4ed3ebe792f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:03.456714 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-30e98675-8cb4-4b21-b94a-b4ed3ebe792f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:03.457461 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-30e98675-8cb4-4b21-b94a-b4ed3ebe792f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:03.458156 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-30e98675-8cb4-4b21-b94a-b4ed3ebe792f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:03.720970 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-10d00ee0-29b5-4635-bf32-dbb4c6242758 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0354d80eb898418fae8acf8baf4894b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2002558f3d814b1b892ca2d22ff25f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:03.729728 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-10d00ee0-29b5-4635-bf32-dbb4c6242758 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] 10.222.0.23 "GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801" status: 200 len: 1314 microversion: 2.1 time: 1.134578 Sep 06 01:12:03.731907 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 32/67] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:02 2022] GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801 => generated 1314 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:03.744512 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-374db185-86b4-4f03-8c06-f5ff9e814551 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:03.746472 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-374db185-86b4-4f03-8c06-f5ff9e814551 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:03.761676 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-374db185-86b4-4f03-8c06-f5ff9e814551 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:03.763291 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-374db185-86b4-4f03-8c06-f5ff9e814551 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:03.765383 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-374db185-86b4-4f03-8c06-f5ff9e814551 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:03.766286 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-374db185-86b4-4f03-8c06-f5ff9e814551 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:03.767705 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-374db185-86b4-4f03-8c06-f5ff9e814551 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:03.768367 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-374db185-86b4-4f03-8c06-f5ff9e814551 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:04.108998 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-30e98675-8cb4-4b21-b94a-b4ed3ebe792f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:04.129759 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-30e98675-8cb4-4b21-b94a-b4ed3ebe792f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e" status: 200 len: 1368 microversion: 2.1 time: 0.697124 Sep 06 01:12:04.153128 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 36/68] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:03 2022] GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e => generated 1368 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:12:04.159773 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-669bc756-3642-4449-ada9-80ad4df60d36 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:04.168029 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-669bc756-3642-4449-ada9-80ad4df60d36 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:04.188066 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-669bc756-3642-4449-ada9-80ad4df60d36 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:04.188873 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-669bc756-3642-4449-ada9-80ad4df60d36 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:04.189488 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-669bc756-3642-4449-ada9-80ad4df60d36 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:04.190651 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-669bc756-3642-4449-ada9-80ad4df60d36 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:04.191620 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-669bc756-3642-4449-ada9-80ad4df60d36 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:04.192227 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-669bc756-3642-4449-ada9-80ad4df60d36 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:04.341165 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-374db185-86b4-4f03-8c06-f5ff9e814551 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:04.363742 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-374db185-86b4-4f03-8c06-f5ff9e814551 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:04.366533 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-374db185-86b4-4f03-8c06-f5ff9e814551 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:04.368257 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-374db185-86b4-4f03-8c06-f5ff9e814551 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1408 microversion: 2.20 time: 0.635204 Sep 06 01:12:04.370769 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 33/69] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:12:03 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1408 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:12:04.642878 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-669bc756-3642-4449-ada9-80ad4df60d36 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:04.648025 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell1:SELECT=100 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:04.663692 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-669bc756-3642-4449-ada9-80ad4df60d36 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1322 microversion: 2.1 time: 0.506221 Sep 06 01:12:04.665635 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 37/70] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:04 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1322 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:04.762786 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-93a28f14-b4fd-40a3-8a1b-3cb586bc3041 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:04.763691 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-93a28f14-b4fd-40a3-8a1b-3cb586bc3041 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] [instance: e19b4dae-fc30-4e15-ad48-d3892ce81801] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:04.769367 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=10 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:04.800793 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93a28f14-b4fd-40a3-8a1b-3cb586bc3041 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:04.802336 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93a28f14-b4fd-40a3-8a1b-3cb586bc3041 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:04.806222 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93a28f14-b4fd-40a3-8a1b-3cb586bc3041 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:04.808358 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93a28f14-b4fd-40a3-8a1b-3cb586bc3041 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:04.809605 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93a28f14-b4fd-40a3-8a1b-3cb586bc3041 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:04.811486 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93a28f14-b4fd-40a3-8a1b-3cb586bc3041 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:05.154455 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-b735da55-f285-4f3d-9947-34a988b0b4ad tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:05.155083 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-b735da55-f285-4f3d-9947-34a988b0b4ad tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:05.163939 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b735da55-f285-4f3d-9947-34a988b0b4ad tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:05.164480 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b735da55-f285-4f3d-9947-34a988b0b4ad tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:05.170596 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b735da55-f285-4f3d-9947-34a988b0b4ad tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:05.171565 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b735da55-f285-4f3d-9947-34a988b0b4ad tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:05.172239 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b735da55-f285-4f3d-9947-34a988b0b4ad tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:05.172872 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b735da55-f285-4f3d-9947-34a988b0b4ad tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:05.255391 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-93a28f14-b4fd-40a3-8a1b-3cb586bc3041 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0354d80eb898418fae8acf8baf4894b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2002558f3d814b1b892ca2d22ff25f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:05.266517 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-93a28f14-b4fd-40a3-8a1b-3cb586bc3041 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] 10.222.0.23 "GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801" status: 200 len: 1314 microversion: 2.1 time: 0.515591 Sep 06 01:12:05.270154 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 34/71] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:04 2022] GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801 => generated 1314 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:05.467625 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-24e64f24-1c77-41d3-8a57-33a5854c46c8 req-c6012ffa-2fe9-40a1-90a2-27878c9b4471 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e", "tag": "cfd96f2a-f172-4913-9442-dad937b6c973"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:12:05.481122 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-24e64f24-1c77-41d3-8a57-33a5854c46c8 req-c6012ffa-2fe9-40a1-90a2-27878c9b4471 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:05.481631 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-24e64f24-1c77-41d3-8a57-33a5854c46c8 req-c6012ffa-2fe9-40a1-90a2-27878c9b4471 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:05.482096 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-24e64f24-1c77-41d3-8a57-33a5854c46c8 req-c6012ffa-2fe9-40a1-90a2-27878c9b4471 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:05.503421 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-24e64f24-1c77-41d3-8a57-33a5854c46c8 req-c6012ffa-2fe9-40a1-90a2-27878c9b4471 service nova] Creating event network-changed:cfd96f2a-f172-4913-9442-dad937b6c973 for instance b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e on hv-cinder-84773 Sep 06 01:12:05.503514 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-24e64f24-1c77-41d3-8a57-33a5854c46c8 req-c6012ffa-2fe9-40a1-90a2-27878c9b4471 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120581) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 06 01:12:05.503888 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-24e64f24-1c77-41d3-8a57-33a5854c46c8 req-c6012ffa-2fe9-40a1-90a2-27878c9b4471 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120581) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 06 01:12:05.505025 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b435fbc6-53a7-460c-b173-07ffe33fbd0d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:05.510531 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b435fbc6-53a7-460c-b173-07ffe33fbd0d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:05.511007 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b435fbc6-53a7-460c-b173-07ffe33fbd0d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:05.512712 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b435fbc6-53a7-460c-b173-07ffe33fbd0d None None] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:05.512712 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b435fbc6-53a7-460c-b173-07ffe33fbd0d None None] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:05.512712 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b435fbc6-53a7-460c-b173-07ffe33fbd0d None None] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:05.523594 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.compute.rpcapi [None req-b435fbc6-53a7-460c-b173-07ffe33fbd0d None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 06 01:12:05.524632 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b435fbc6-53a7-460c-b173-07ffe33fbd0d None None] Releasing lock "compute-rpcapi-router" {{(pid=120581) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 06 01:12:05.535617 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-b735da55-f285-4f3d-9947-34a988b0b4ad tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:05.545333 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-b735da55-f285-4f3d-9947-34a988b0b4ad tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e" status: 200 len: 1368 microversion: 2.1 time: 0.394683 Sep 06 01:12:05.548815 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 38/72] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:05 2022] GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e => generated 1368 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:05.553532 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-83f0d8ad-0df0-43f3-bbe6-2fb2a4be73e1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:05.554396 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-83f0d8ad-0df0-43f3-bbe6-2fb2a4be73e1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:05.562503 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-83f0d8ad-0df0-43f3-bbe6-2fb2a4be73e1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:05.564476 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b435fbc6-53a7-460c-b173-07ffe33fbd0d None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.242585 Sep 06 01:12:05.565297 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 35/73] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 01:12:05.568469 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-83f0d8ad-0df0-43f3-bbe6-2fb2a4be73e1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:05.569980 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-83f0d8ad-0df0-43f3-bbe6-2fb2a4be73e1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:05.570761 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-83f0d8ad-0df0-43f3-bbe6-2fb2a4be73e1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:05.571138 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-b87ab221-1121-4626-a66a-527ef9371e9f req-1cb30dfe-7328-4c1f-8fd5-3305bd3410a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88683beb-47e8-46e9-af24-4098c50a674a", "tag": "1453654f-e3a0-4c17-8fd8-4d6102d43d13"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:12:05.571255 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-83f0d8ad-0df0-43f3-bbe6-2fb2a4be73e1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:05.571666 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-83f0d8ad-0df0-43f3-bbe6-2fb2a4be73e1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:05.596278 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b87ab221-1121-4626-a66a-527ef9371e9f req-1cb30dfe-7328-4c1f-8fd5-3305bd3410a1 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:05.597088 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b87ab221-1121-4626-a66a-527ef9371e9f req-1cb30dfe-7328-4c1f-8fd5-3305bd3410a1 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:05.597985 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b87ab221-1121-4626-a66a-527ef9371e9f req-1cb30dfe-7328-4c1f-8fd5-3305bd3410a1 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:05.611629 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-b87ab221-1121-4626-a66a-527ef9371e9f req-1cb30dfe-7328-4c1f-8fd5-3305bd3410a1 service nova] Creating event network-changed:1453654f-e3a0-4c17-8fd8-4d6102d43d13 for instance 88683beb-47e8-46e9-af24-4098c50a674a on hv-cinder-84773 Sep 06 01:12:05.618209 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-b87ab221-1121-4626-a66a-527ef9371e9f req-1cb30dfe-7328-4c1f-8fd5-3305bd3410a1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050982 Sep 06 01:12:05.619079 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 36/74] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:12:05.692852 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-04f54bbc-f155-4c8d-b16e-68fba2d9cc49 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:05.694302 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-04f54bbc-f155-4c8d-b16e-68fba2d9cc49 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:05.704687 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-04f54bbc-f155-4c8d-b16e-68fba2d9cc49 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:05.705813 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-04f54bbc-f155-4c8d-b16e-68fba2d9cc49 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:05.706358 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-04f54bbc-f155-4c8d-b16e-68fba2d9cc49 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:05.707172 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-04f54bbc-f155-4c8d-b16e-68fba2d9cc49 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:05.708650 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-04f54bbc-f155-4c8d-b16e-68fba2d9cc49 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:05.709196 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-04f54bbc-f155-4c8d-b16e-68fba2d9cc49 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:05.751087 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:05.841266 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-83f0d8ad-0df0-43f3-bbe6-2fb2a4be73e1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:05.855021 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-83f0d8ad-0df0-43f3-bbe6-2fb2a4be73e1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:05.857821 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-83f0d8ad-0df0-43f3-bbe6-2fb2a4be73e1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:05.859701 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-83f0d8ad-0df0-43f3-bbe6-2fb2a4be73e1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1408 microversion: 2.20 time: 0.309808 Sep 06 01:12:05.862263 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 39/75] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:12:05 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1408 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:12:05.986968 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-04f54bbc-f155-4c8d-b16e-68fba2d9cc49 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:05.996003 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-04f54bbc-f155-4c8d-b16e-68fba2d9cc49 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1322 microversion: 2.1 time: 0.307255 Sep 06 01:12:05.997220 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 37/76] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:05 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1322 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:12:06.290670 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-82132334-bde7-43c2-95b0-3aa405a86d31 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:06.291560 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-82132334-bde7-43c2-95b0-3aa405a86d31 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] [instance: e19b4dae-fc30-4e15-ad48-d3892ce81801] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:06.294817 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=7 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:06.298946 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-82132334-bde7-43c2-95b0-3aa405a86d31 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:06.299438 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-82132334-bde7-43c2-95b0-3aa405a86d31 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:06.299891 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-82132334-bde7-43c2-95b0-3aa405a86d31 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:06.300643 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-82132334-bde7-43c2-95b0-3aa405a86d31 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:06.301093 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-82132334-bde7-43c2-95b0-3aa405a86d31 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:06.301506 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-82132334-bde7-43c2-95b0-3aa405a86d31 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:06.544851 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-82132334-bde7-43c2-95b0-3aa405a86d31 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0354d80eb898418fae8acf8baf4894b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2002558f3d814b1b892ca2d22ff25f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:06.561616 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-82132334-bde7-43c2-95b0-3aa405a86d31 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] 10.222.0.23 "GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801" status: 200 len: 1314 microversion: 2.1 time: 0.274849 Sep 06 01:12:06.577650 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f9f338c9-eb63-4d8d-8364-ccef52660bb5 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:06.577650 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f9f338c9-eb63-4d8d-8364-ccef52660bb5 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:06.581648 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 40/77] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:06 2022] GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:06.584959 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f9f338c9-eb63-4d8d-8364-ccef52660bb5 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:06.587996 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f9f338c9-eb63-4d8d-8364-ccef52660bb5 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:06.590007 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f9f338c9-eb63-4d8d-8364-ccef52660bb5 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:06.590887 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f9f338c9-eb63-4d8d-8364-ccef52660bb5 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:06.592856 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f9f338c9-eb63-4d8d-8364-ccef52660bb5 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:06.594045 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f9f338c9-eb63-4d8d-8364-ccef52660bb5 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:06.886111 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-a72e5102-51e8-4509-bf13-efa8475aad50 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:06.886995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-a72e5102-51e8-4509-bf13-efa8475aad50 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:06.895570 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a72e5102-51e8-4509-bf13-efa8475aad50 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:06.897426 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a72e5102-51e8-4509-bf13-efa8475aad50 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:06.897865 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a72e5102-51e8-4509-bf13-efa8475aad50 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:06.899448 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a72e5102-51e8-4509-bf13-efa8475aad50 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:06.902078 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a72e5102-51e8-4509-bf13-efa8475aad50 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:06.902626 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a72e5102-51e8-4509-bf13-efa8475aad50 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:07.319456 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-f9f338c9-eb63-4d8d-8364-ccef52660bb5 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:07.331262 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f9f338c9-eb63-4d8d-8364-ccef52660bb5 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e" status: 200 len: 1368 microversion: 2.1 time: 0.759563 Sep 06 01:12:07.331866 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 38/78] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:06 2022] GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e => generated 1368 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:07.350767 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-98199634-d18a-4d51-adbc-27598a777156 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:07.353064 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-98199634-d18a-4d51-adbc-27598a777156 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:07.366098 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98199634-d18a-4d51-adbc-27598a777156 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:07.366861 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98199634-d18a-4d51-adbc-27598a777156 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:07.370828 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98199634-d18a-4d51-adbc-27598a777156 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:07.371912 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98199634-d18a-4d51-adbc-27598a777156 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:07.372546 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98199634-d18a-4d51-adbc-27598a777156 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:07.373252 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98199634-d18a-4d51-adbc-27598a777156 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:07.741237 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-a72e5102-51e8-4509-bf13-efa8475aad50 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:07.756250 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-a72e5102-51e8-4509-bf13-efa8475aad50 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:07.757725 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-a72e5102-51e8-4509-bf13-efa8475aad50 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:07.758877 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-a72e5102-51e8-4509-bf13-efa8475aad50 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1408 microversion: 2.20 time: 0.876629 Sep 06 01:12:07.771816 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 41/79] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:12:06 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1408 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:12:07.772089 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-3fc7ed7d-b00b-4d74-9c84-385edf8bcc2e tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:07.772710 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-3fc7ed7d-b00b-4d74-9c84-385edf8bcc2e tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] [instance: e19b4dae-fc30-4e15-ad48-d3892ce81801] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:07.790048 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3fc7ed7d-b00b-4d74-9c84-385edf8bcc2e tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:07.793951 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3fc7ed7d-b00b-4d74-9c84-385edf8bcc2e tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:07.794619 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3fc7ed7d-b00b-4d74-9c84-385edf8bcc2e tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:07.797149 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3fc7ed7d-b00b-4d74-9c84-385edf8bcc2e tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:07.797626 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3fc7ed7d-b00b-4d74-9c84-385edf8bcc2e tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:07.798062 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3fc7ed7d-b00b-4d74-9c84-385edf8bcc2e tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:07.820524 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-98199634-d18a-4d51-adbc-27598a777156 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:07.831695 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-98199634-d18a-4d51-adbc-27598a777156 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1322 microversion: 2.1 time: 0.498078 Sep 06 01:12:07.834263 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 39/80] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:07 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1322 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:07.844757 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-1fe17145-0d4c-4e1e-9603-c3c6534530f9 req-cdb55223-3bd1-4d43-b8a0-3b3385f5453b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c42df4ca-a678-4b12-b5dc-3f3c0af93125", "tag": "9f5084ac-bd14-44b7-bba5-06b59fd5291e"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:12:07.868752 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-1fe17145-0d4c-4e1e-9603-c3c6534530f9 req-cdb55223-3bd1-4d43-b8a0-3b3385f5453b service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:07.869226 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-1fe17145-0d4c-4e1e-9603-c3c6534530f9 req-cdb55223-3bd1-4d43-b8a0-3b3385f5453b service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:07.869849 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-1fe17145-0d4c-4e1e-9603-c3c6534530f9 req-cdb55223-3bd1-4d43-b8a0-3b3385f5453b service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:07.882891 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-1fe17145-0d4c-4e1e-9603-c3c6534530f9 req-cdb55223-3bd1-4d43-b8a0-3b3385f5453b service nova] Creating event network-changed:9f5084ac-bd14-44b7-bba5-06b59fd5291e for instance c42df4ca-a678-4b12-b5dc-3f3c0af93125 on hv-cinder-84773 Sep 06 01:12:07.888745 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-1fe17145-0d4c-4e1e-9603-c3c6534530f9 req-cdb55223-3bd1-4d43-b8a0-3b3385f5453b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053027 Sep 06 01:12:07.889577 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 40/81] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:12:08.026088 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-3fc7ed7d-b00b-4d74-9c84-385edf8bcc2e tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0354d80eb898418fae8acf8baf4894b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2002558f3d814b1b892ca2d22ff25f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:08.036321 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-3fc7ed7d-b00b-4d74-9c84-385edf8bcc2e tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] 10.222.0.23 "GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801" status: 200 len: 1314 microversion: 2.1 time: 0.268245 Sep 06 01:12:08.037305 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 42/82] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:07 2022] GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:08.361747 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b8168962-54a7-4826-97c7-73fcb452d8bd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:08.363106 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b8168962-54a7-4826-97c7-73fcb452d8bd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:08.370994 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8168962-54a7-4826-97c7-73fcb452d8bd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:08.371729 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8168962-54a7-4826-97c7-73fcb452d8bd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:08.372419 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8168962-54a7-4826-97c7-73fcb452d8bd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:08.373371 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8168962-54a7-4826-97c7-73fcb452d8bd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:08.373900 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8168962-54a7-4826-97c7-73fcb452d8bd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:08.374512 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8168962-54a7-4826-97c7-73fcb452d8bd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:08.792762 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-b8168962-54a7-4826-97c7-73fcb452d8bd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:08.795789 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-ff178a20-77b6-4e37-837f-e2f725170650 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:08.796405 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-ff178a20-77b6-4e37-837f-e2f725170650 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:08.805170 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b8168962-54a7-4826-97c7-73fcb452d8bd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e" status: 200 len: 1368 microversion: 2.1 time: 0.446954 Sep 06 01:12:08.805762 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 41/83] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:08 2022] GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e => generated 1368 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:08.813171 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ff178a20-77b6-4e37-837f-e2f725170650 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:08.813964 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ff178a20-77b6-4e37-837f-e2f725170650 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:08.816561 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ff178a20-77b6-4e37-837f-e2f725170650 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:08.817600 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ff178a20-77b6-4e37-837f-e2f725170650 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:08.818120 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ff178a20-77b6-4e37-837f-e2f725170650 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:08.818587 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ff178a20-77b6-4e37-837f-e2f725170650 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:08.859844 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2bce6096-2d66-4b99-a517-822d9ed165a6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:08.861447 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2bce6096-2d66-4b99-a517-822d9ed165a6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:08.874522 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2bce6096-2d66-4b99-a517-822d9ed165a6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:08.876618 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2bce6096-2d66-4b99-a517-822d9ed165a6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:08.878114 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2bce6096-2d66-4b99-a517-822d9ed165a6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:08.880602 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2bce6096-2d66-4b99-a517-822d9ed165a6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:08.881667 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2bce6096-2d66-4b99-a517-822d9ed165a6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:08.883652 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2bce6096-2d66-4b99-a517-822d9ed165a6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:09.196456 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-ff178a20-77b6-4e37-837f-e2f725170650 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:09.211086 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-ff178a20-77b6-4e37-837f-e2f725170650 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:09.214158 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-ff178a20-77b6-4e37-837f-e2f725170650 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:09.220750 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-ff178a20-77b6-4e37-837f-e2f725170650 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1408 microversion: 2.20 time: 0.431782 Sep 06 01:12:09.224429 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 43/84] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:12:08 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1408 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:12:09.237587 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-f8be747a-fffd-463a-a645-aeb5df0d1dc1 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:09.241891 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-f8be747a-fffd-463a-a645-aeb5df0d1dc1 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] [instance: e19b4dae-fc30-4e15-ad48-d3892ce81801] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:09.255408 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f8be747a-fffd-463a-a645-aeb5df0d1dc1 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:09.259052 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f8be747a-fffd-463a-a645-aeb5df0d1dc1 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:09.261240 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f8be747a-fffd-463a-a645-aeb5df0d1dc1 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:09.261387 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-2bce6096-2d66-4b99-a517-822d9ed165a6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:09.263957 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f8be747a-fffd-463a-a645-aeb5df0d1dc1 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:09.264724 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f8be747a-fffd-463a-a645-aeb5df0d1dc1 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:09.266407 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f8be747a-fffd-463a-a645-aeb5df0d1dc1 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:09.269885 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2bce6096-2d66-4b99-a517-822d9ed165a6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1322 microversion: 2.1 time: 0.415613 Sep 06 01:12:09.283711 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 42/85] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:08 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1322 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:09.538863 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-f8be747a-fffd-463a-a645-aeb5df0d1dc1 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0354d80eb898418fae8acf8baf4894b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2002558f3d814b1b892ca2d22ff25f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:09.552851 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-f8be747a-fffd-463a-a645-aeb5df0d1dc1 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] 10.222.0.23 "GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801" status: 200 len: 1314 microversion: 2.1 time: 0.326560 Sep 06 01:12:09.556508 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 44/86] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:09 2022] GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801 => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:09.828826 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3aa67ecb-8380-4394-b79e-6ae51ab1980c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:09.829619 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3aa67ecb-8380-4394-b79e-6ae51ab1980c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:09.837037 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3aa67ecb-8380-4394-b79e-6ae51ab1980c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:09.837555 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3aa67ecb-8380-4394-b79e-6ae51ab1980c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:09.837995 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3aa67ecb-8380-4394-b79e-6ae51ab1980c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:09.838722 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3aa67ecb-8380-4394-b79e-6ae51ab1980c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:09.839174 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3aa67ecb-8380-4394-b79e-6ae51ab1980c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:09.839841 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3aa67ecb-8380-4394-b79e-6ae51ab1980c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:09.987871 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-3aa67ecb-8380-4394-b79e-6ae51ab1980c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:09.996475 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3aa67ecb-8380-4394-b79e-6ae51ab1980c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e" status: 200 len: 1368 microversion: 2.1 time: 0.172510 Sep 06 01:12:09.997185 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 43/87] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:09 2022] GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:10.254918 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-caf36891-e56d-4f6a-8f69-9c8a17e18044 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:10.256016 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-caf36891-e56d-4f6a-8f69-9c8a17e18044 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:10.268737 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-caf36891-e56d-4f6a-8f69-9c8a17e18044 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:10.269409 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-caf36891-e56d-4f6a-8f69-9c8a17e18044 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:10.270086 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-caf36891-e56d-4f6a-8f69-9c8a17e18044 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:10.270956 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-caf36891-e56d-4f6a-8f69-9c8a17e18044 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:10.271514 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-caf36891-e56d-4f6a-8f69-9c8a17e18044 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:10.272114 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-caf36891-e56d-4f6a-8f69-9c8a17e18044 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:10.296310 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d4d31c58-b27d-4563-82b1-29bd844ba647 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:10.297312 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d4d31c58-b27d-4563-82b1-29bd844ba647 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:10.307195 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4d31c58-b27d-4563-82b1-29bd844ba647 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:10.309718 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4d31c58-b27d-4563-82b1-29bd844ba647 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:10.310192 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4d31c58-b27d-4563-82b1-29bd844ba647 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:10.311216 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4d31c58-b27d-4563-82b1-29bd844ba647 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:10.316580 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4d31c58-b27d-4563-82b1-29bd844ba647 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:10.322231 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4d31c58-b27d-4563-82b1-29bd844ba647 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:10.715142 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-caf36891-e56d-4f6a-8f69-9c8a17e18044 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:10.718152 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-d4d31c58-b27d-4563-82b1-29bd844ba647 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:10.729792 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-caf36891-e56d-4f6a-8f69-9c8a17e18044 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:10.731048 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d4d31c58-b27d-4563-82b1-29bd844ba647 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1322 microversion: 2.1 time: 0.439961 Sep 06 01:12:10.731633 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 44/88] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:10 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1322 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:12:10.732268 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-caf36891-e56d-4f6a-8f69-9c8a17e18044 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:10.733721 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-caf36891-e56d-4f6a-8f69-9c8a17e18044 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1408 microversion: 2.20 time: 0.487370 Sep 06 01:12:10.749631 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 45/89] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:12:10 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1408 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:12:10.753129 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e01647ff-f2bb-4508-91fe-42ebd7a08cee tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:10.753941 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e01647ff-f2bb-4508-91fe-42ebd7a08cee tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] [instance: e19b4dae-fc30-4e15-ad48-d3892ce81801] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:10.763217 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e01647ff-f2bb-4508-91fe-42ebd7a08cee tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:10.764373 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e01647ff-f2bb-4508-91fe-42ebd7a08cee tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:10.764959 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e01647ff-f2bb-4508-91fe-42ebd7a08cee tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:10.766233 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e01647ff-f2bb-4508-91fe-42ebd7a08cee tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:10.767861 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e01647ff-f2bb-4508-91fe-42ebd7a08cee tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:10.768440 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e01647ff-f2bb-4508-91fe-42ebd7a08cee tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:10.939243 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-e01647ff-f2bb-4508-91fe-42ebd7a08cee tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0354d80eb898418fae8acf8baf4894b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2002558f3d814b1b892ca2d22ff25f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:10.947513 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e01647ff-f2bb-4508-91fe-42ebd7a08cee tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] 10.222.0.23 "GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801" status: 200 len: 1314 microversion: 2.1 time: 0.206712 Sep 06 01:12:10.948114 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 45/90] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:10 2022] GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:11.019324 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-df510a02-c5d9-4812-a538-0554ea78e82a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:11.020290 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-df510a02-c5d9-4812-a538-0554ea78e82a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:11.022184 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell0:SELECT=2 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:11.028375 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-df510a02-c5d9-4812-a538-0554ea78e82a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:11.029041 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-df510a02-c5d9-4812-a538-0554ea78e82a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:11.029568 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-df510a02-c5d9-4812-a538-0554ea78e82a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:11.030380 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-df510a02-c5d9-4812-a538-0554ea78e82a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:11.030933 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-df510a02-c5d9-4812-a538-0554ea78e82a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:11.031415 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-df510a02-c5d9-4812-a538-0554ea78e82a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:11.194515 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-df510a02-c5d9-4812-a538-0554ea78e82a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:11.205071 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-df510a02-c5d9-4812-a538-0554ea78e82a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e" status: 200 len: 1368 microversion: 2.1 time: 0.190310 Sep 06 01:12:11.206073 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 46/91] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:11 2022] GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e => generated 1368 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:11.753440 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-27682b47-b38d-4fa1-af0a-999e780e32a8 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:11.754047 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-27682b47-b38d-4fa1-af0a-999e780e32a8 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:11.759924 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27682b47-b38d-4fa1-af0a-999e780e32a8 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:11.760460 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27682b47-b38d-4fa1-af0a-999e780e32a8 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:11.760831 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27682b47-b38d-4fa1-af0a-999e780e32a8 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:11.761555 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27682b47-b38d-4fa1-af0a-999e780e32a8 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:11.762004 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27682b47-b38d-4fa1-af0a-999e780e32a8 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:11.766921 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-6ccbbe20-ec79-4b03-bb97-bdb0d3f7b729 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:11.767525 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-6ccbbe20-ec79-4b03-bb97-bdb0d3f7b729 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:11.770537 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27682b47-b38d-4fa1-af0a-999e780e32a8 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:11.774396 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6ccbbe20-ec79-4b03-bb97-bdb0d3f7b729 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:11.775085 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6ccbbe20-ec79-4b03-bb97-bdb0d3f7b729 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:11.775651 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6ccbbe20-ec79-4b03-bb97-bdb0d3f7b729 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:11.777003 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6ccbbe20-ec79-4b03-bb97-bdb0d3f7b729 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:11.777463 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6ccbbe20-ec79-4b03-bb97-bdb0d3f7b729 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:11.777889 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6ccbbe20-ec79-4b03-bb97-bdb0d3f7b729 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:11.976696 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-27682b47-b38d-4fa1-af0a-999e780e32a8 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:11.979674 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-6ccbbe20-ec79-4b03-bb97-bdb0d3f7b729 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:11.987511 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-27682b47-b38d-4fa1-af0a-999e780e32a8 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1322 microversion: 2.1 time: 0.237854 Sep 06 01:12:12.000039 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 46/92] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:11 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:12.000191 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-6ccbbe20-ec79-4b03-bb97-bdb0d3f7b729 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:12.000191 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-6ccbbe20-ec79-4b03-bb97-bdb0d3f7b729 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:12.000191 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-6ccbbe20-ec79-4b03-bb97-bdb0d3f7b729 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1408 microversion: 2.20 time: 0.228805 Sep 06 01:12:12.000496 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 47/93] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:12:11 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1408 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:12:12.006701 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-465c7354-2304-4cc7-a4e5-169d7a986259 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:12.008611 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-465c7354-2304-4cc7-a4e5-169d7a986259 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] [instance: e19b4dae-fc30-4e15-ad48-d3892ce81801] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:12.018718 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-465c7354-2304-4cc7-a4e5-169d7a986259 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:12.019233 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-465c7354-2304-4cc7-a4e5-169d7a986259 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:12.019678 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-465c7354-2304-4cc7-a4e5-169d7a986259 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:12.020418 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-465c7354-2304-4cc7-a4e5-169d7a986259 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:12.020893 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-465c7354-2304-4cc7-a4e5-169d7a986259 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:12.021308 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-465c7354-2304-4cc7-a4e5-169d7a986259 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:12.182888 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-465c7354-2304-4cc7-a4e5-169d7a986259 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0354d80eb898418fae8acf8baf4894b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2002558f3d814b1b892ca2d22ff25f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:12.190561 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-465c7354-2304-4cc7-a4e5-169d7a986259 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] 10.222.0.23 "GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801" status: 200 len: 1314 microversion: 2.1 time: 0.201473 Sep 06 01:12:12.191134 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 47/94] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:11 2022] GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:12.227667 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-b5ad1780-3c67-431b-8141-eaa84585ea71 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:12.228303 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-b5ad1780-3c67-431b-8141-eaa84585ea71 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:12.234035 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b5ad1780-3c67-431b-8141-eaa84585ea71 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:12.234591 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b5ad1780-3c67-431b-8141-eaa84585ea71 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:12.234894 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b5ad1780-3c67-431b-8141-eaa84585ea71 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:12.235639 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b5ad1780-3c67-431b-8141-eaa84585ea71 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:12.236352 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b5ad1780-3c67-431b-8141-eaa84585ea71 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:12.236812 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b5ad1780-3c67-431b-8141-eaa84585ea71 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:12.394866 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-b5ad1780-3c67-431b-8141-eaa84585ea71 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:12.403714 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-b5ad1780-3c67-431b-8141-eaa84585ea71 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e" status: 200 len: 1368 microversion: 2.1 time: 0.179769 Sep 06 01:12:12.404299 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 48/95] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:12 2022] GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e => generated 1368 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:13.015099 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bafdcaf6-f8dd-49f8-80b3-9b3e6d32613f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:13.015724 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bafdcaf6-f8dd-49f8-80b3-9b3e6d32613f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:13.018706 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-e2c0ede0-3280-4118-bf95-41978712a418 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:13.019456 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-e2c0ede0-3280-4118-bf95-41978712a418 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:13.026169 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bafdcaf6-f8dd-49f8-80b3-9b3e6d32613f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:13.026942 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bafdcaf6-f8dd-49f8-80b3-9b3e6d32613f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:13.027392 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bafdcaf6-f8dd-49f8-80b3-9b3e6d32613f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:13.028140 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bafdcaf6-f8dd-49f8-80b3-9b3e6d32613f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:13.028765 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bafdcaf6-f8dd-49f8-80b3-9b3e6d32613f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:13.029197 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bafdcaf6-f8dd-49f8-80b3-9b3e6d32613f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:13.032879 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e2c0ede0-3280-4118-bf95-41978712a418 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:13.033372 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e2c0ede0-3280-4118-bf95-41978712a418 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:13.033806 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e2c0ede0-3280-4118-bf95-41978712a418 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:13.034501 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e2c0ede0-3280-4118-bf95-41978712a418 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:13.036760 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e2c0ede0-3280-4118-bf95-41978712a418 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:13.041580 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e2c0ede0-3280-4118-bf95-41978712a418 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:13.338703 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-e2c0ede0-3280-4118-bf95-41978712a418 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:13.354246 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-e2c0ede0-3280-4118-bf95-41978712a418 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:13.356059 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-e2c0ede0-3280-4118-bf95-41978712a418 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:13.361154 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-e2c0ede0-3280-4118-bf95-41978712a418 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1408 microversion: 2.20 time: 0.347582 Sep 06 01:12:13.368030 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 49/96] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:12:13 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1408 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:12:13.418219 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-bafdcaf6-f8dd-49f8-80b3-9b3e6d32613f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:13.432203 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bafdcaf6-f8dd-49f8-80b3-9b3e6d32613f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1322 microversion: 2.1 time: 0.423128 Sep 06 01:12:13.433594 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 48/97] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:13 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1322 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:13.464978 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4123fc63-5893-42ed-9f3c-1bdcf5c7690f tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:13.468065 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4123fc63-5893-42ed-9f3c-1bdcf5c7690f tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] [instance: e19b4dae-fc30-4e15-ad48-d3892ce81801] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:13.484892 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4123fc63-5893-42ed-9f3c-1bdcf5c7690f tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:13.485391 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4123fc63-5893-42ed-9f3c-1bdcf5c7690f tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:13.487191 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4123fc63-5893-42ed-9f3c-1bdcf5c7690f tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:13.490067 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4123fc63-5893-42ed-9f3c-1bdcf5c7690f tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:13.493437 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4123fc63-5893-42ed-9f3c-1bdcf5c7690f tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:13.494850 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4123fc63-5893-42ed-9f3c-1bdcf5c7690f tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:13.614315 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-da6726bf-7f59-4f7e-92ed-0d1ad1a004e3 req-ae3165c8-4b47-4c4f-9918-faa173c295bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf424d2a-0a95-48dc-9ee5-13fab569cb43", "name": "network-vif-plugged", "status": "completed", "tag": "c4540d59-8bd2-4cb6-a994-d575e41892b8"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:12:13.624841 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-da6726bf-7f59-4f7e-92ed-0d1ad1a004e3 req-ae3165c8-4b47-4c4f-9918-faa173c295bc service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:13.625569 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-da6726bf-7f59-4f7e-92ed-0d1ad1a004e3 req-ae3165c8-4b47-4c4f-9918-faa173c295bc service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:13.626002 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-da6726bf-7f59-4f7e-92ed-0d1ad1a004e3 req-ae3165c8-4b47-4c4f-9918-faa173c295bc service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:13.638591 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.compute.server_external_events [req-da6726bf-7f59-4f7e-92ed-0d1ad1a004e3 req-ae3165c8-4b47-4c4f-9918-faa173c295bc service nova] Creating event network-vif-plugged:c4540d59-8bd2-4cb6-a994-d575e41892b8 for instance cf424d2a-0a95-48dc-9ee5-13fab569cb43 on hv-cinder-84773 Sep 06 01:12:13.643826 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [req-da6726bf-7f59-4f7e-92ed-0d1ad1a004e3 req-ae3165c8-4b47-4c4f-9918-faa173c295bc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.275313 Sep 06 01:12:13.644445 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 50/98] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:12:13.658574 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-91d050f4-a49b-40ee-a6f6-4d7f62445bed tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:13.659014 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-91d050f4-a49b-40ee-a6f6-4d7f62445bed tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:13.665931 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-91d050f4-a49b-40ee-a6f6-4d7f62445bed tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:13.666419 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-91d050f4-a49b-40ee-a6f6-4d7f62445bed tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:13.667044 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-91d050f4-a49b-40ee-a6f6-4d7f62445bed tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:13.667985 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-91d050f4-a49b-40ee-a6f6-4d7f62445bed tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:13.668863 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-91d050f4-a49b-40ee-a6f6-4d7f62445bed tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:13.669461 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-91d050f4-a49b-40ee-a6f6-4d7f62445bed tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:13.726538 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-4123fc63-5893-42ed-9f3c-1bdcf5c7690f tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0354d80eb898418fae8acf8baf4894b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2002558f3d814b1b892ca2d22ff25f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:13.734665 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4123fc63-5893-42ed-9f3c-1bdcf5c7690f tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] 10.222.0.23 "GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801" status: 200 len: 1314 microversion: 2.1 time: 0.282145 Sep 06 01:12:13.735242 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 49/99] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:13 2022] GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:13.864761 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-91d050f4-a49b-40ee-a6f6-4d7f62445bed tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:13.872795 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-91d050f4-a49b-40ee-a6f6-4d7f62445bed tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e" status: 200 len: 1368 microversion: 2.1 time: 0.227138 Sep 06 01:12:13.873535 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 51/100] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:13 2022] GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e => generated 1368 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:14.392730 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e63093b9-a926-426b-b46c-27a54d824683 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:14.393460 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e63093b9-a926-426b-b46c-27a54d824683 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:14.399410 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e63093b9-a926-426b-b46c-27a54d824683 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:14.399998 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e63093b9-a926-426b-b46c-27a54d824683 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:14.400505 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e63093b9-a926-426b-b46c-27a54d824683 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:14.401250 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e63093b9-a926-426b-b46c-27a54d824683 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:14.401788 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e63093b9-a926-426b-b46c-27a54d824683 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:14.402272 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e63093b9-a926-426b-b46c-27a54d824683 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:14.463835 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-309f0f83-4b88-42f3-b0ae-31416495a1e4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:14.464588 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-309f0f83-4b88-42f3-b0ae-31416495a1e4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:14.472017 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-309f0f83-4b88-42f3-b0ae-31416495a1e4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:14.472727 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-309f0f83-4b88-42f3-b0ae-31416495a1e4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:14.473359 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-309f0f83-4b88-42f3-b0ae-31416495a1e4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:14.474491 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-309f0f83-4b88-42f3-b0ae-31416495a1e4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:14.475503 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-309f0f83-4b88-42f3-b0ae-31416495a1e4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:14.476290 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-309f0f83-4b88-42f3-b0ae-31416495a1e4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:14.613065 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-e63093b9-a926-426b-b46c-27a54d824683 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:14.631037 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-e63093b9-a926-426b-b46c-27a54d824683 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:14.633135 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-e63093b9-a926-426b-b46c-27a54d824683 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:14.634479 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e63093b9-a926-426b-b46c-27a54d824683 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1408 microversion: 2.20 time: 0.245756 Sep 06 01:12:14.635207 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 50/101] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:12:14 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1408 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:12:14.666142 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-309f0f83-4b88-42f3-b0ae-31416495a1e4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:14.673596 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-309f0f83-4b88-42f3-b0ae-31416495a1e4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1322 microversion: 2.1 time: 0.216910 Sep 06 01:12:14.674172 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 52/102] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:14 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:14.756930 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ec774689-d20d-41e8-8dcb-a891312a2aa4 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:14.757549 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ec774689-d20d-41e8-8dcb-a891312a2aa4 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] [instance: e19b4dae-fc30-4e15-ad48-d3892ce81801] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:14.766305 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec774689-d20d-41e8-8dcb-a891312a2aa4 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:14.766846 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec774689-d20d-41e8-8dcb-a891312a2aa4 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:14.767281 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec774689-d20d-41e8-8dcb-a891312a2aa4 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:14.768250 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec774689-d20d-41e8-8dcb-a891312a2aa4 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:14.768583 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec774689-d20d-41e8-8dcb-a891312a2aa4 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:14.771970 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec774689-d20d-41e8-8dcb-a891312a2aa4 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:14.896221 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-8e3b8d24-7973-4096-b03f-c87a1a1a5678 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:14.896911 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-8e3b8d24-7973-4096-b03f-c87a1a1a5678 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:14.907212 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8e3b8d24-7973-4096-b03f-c87a1a1a5678 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:14.907713 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8e3b8d24-7973-4096-b03f-c87a1a1a5678 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:14.908205 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8e3b8d24-7973-4096-b03f-c87a1a1a5678 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:14.909019 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8e3b8d24-7973-4096-b03f-c87a1a1a5678 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:14.909482 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8e3b8d24-7973-4096-b03f-c87a1a1a5678 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:14.910287 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8e3b8d24-7973-4096-b03f-c87a1a1a5678 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:14.951574 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-ec774689-d20d-41e8-8dcb-a891312a2aa4 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0354d80eb898418fae8acf8baf4894b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2002558f3d814b1b892ca2d22ff25f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:14.962405 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ec774689-d20d-41e8-8dcb-a891312a2aa4 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] 10.222.0.23 "GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801" status: 200 len: 1314 microversion: 2.1 time: 0.208980 Sep 06 01:12:14.963446 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 51/103] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:14 2022] GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:15.133950 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-8e3b8d24-7973-4096-b03f-c87a1a1a5678 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:15.145568 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-8e3b8d24-7973-4096-b03f-c87a1a1a5678 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e" status: 200 len: 1368 microversion: 2.1 time: 0.253135 Sep 06 01:12:15.146798 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 53/104] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:14 2022] GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e => generated 1368 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:12:15.663949 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-a987b9d4-a7bc-4681-8fa7-262222c842be req-e0ad7813-17cb-487e-a9bb-1ed1754947a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e19b4dae-fc30-4e15-ad48-d3892ce81801", "name": "network-vif-plugged", "status": "completed", "tag": "32b70eb8-cd96-473d-8902-5e15e8eae911"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:12:15.664596 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-41b1ba6a-631d-43ee-951f-bc3bce166445 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:15.665396 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-41b1ba6a-631d-43ee-951f-bc3bce166445 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:15.669747 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:15.676999 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a987b9d4-a7bc-4681-8fa7-262222c842be req-e0ad7813-17cb-487e-a9bb-1ed1754947a7 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:15.677883 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a987b9d4-a7bc-4681-8fa7-262222c842be req-e0ad7813-17cb-487e-a9bb-1ed1754947a7 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:15.681173 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a987b9d4-a7bc-4681-8fa7-262222c842be req-e0ad7813-17cb-487e-a9bb-1ed1754947a7 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:15.690389 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-41b1ba6a-631d-43ee-951f-bc3bce166445 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:15.692118 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-41b1ba6a-631d-43ee-951f-bc3bce166445 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:15.692677 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-41b1ba6a-631d-43ee-951f-bc3bce166445 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:15.695901 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-41b1ba6a-631d-43ee-951f-bc3bce166445 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:15.698045 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-41b1ba6a-631d-43ee-951f-bc3bce166445 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:15.699744 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-41b1ba6a-631d-43ee-951f-bc3bce166445 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:15.700554 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-a987b9d4-a7bc-4681-8fa7-262222c842be req-e0ad7813-17cb-487e-a9bb-1ed1754947a7 service nova] Creating event network-vif-plugged:32b70eb8-cd96-473d-8902-5e15e8eae911 for instance e19b4dae-fc30-4e15-ad48-d3892ce81801 on hv-cinder-84773 Sep 06 01:12:15.713061 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-a987b9d4-a7bc-4681-8fa7-262222c842be req-e0ad7813-17cb-487e-a9bb-1ed1754947a7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053708 Sep 06 01:12:15.714846 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 52/105] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:12:15.722635 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5195e6e3-03a0-4ee3-9204-a372cad3b479 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:15.723573 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5195e6e3-03a0-4ee3-9204-a372cad3b479 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:15.733019 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5195e6e3-03a0-4ee3-9204-a372cad3b479 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:15.733744 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5195e6e3-03a0-4ee3-9204-a372cad3b479 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:15.734360 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5195e6e3-03a0-4ee3-9204-a372cad3b479 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:15.735230 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5195e6e3-03a0-4ee3-9204-a372cad3b479 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:15.736029 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5195e6e3-03a0-4ee3-9204-a372cad3b479 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:15.736443 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5195e6e3-03a0-4ee3-9204-a372cad3b479 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:15.990296 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-5195e6e3-03a0-4ee3-9204-a372cad3b479 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:16.008265 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-41b1ba6a-631d-43ee-951f-bc3bce166445 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:16.014588 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5195e6e3-03a0-4ee3-9204-a372cad3b479 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1322 microversion: 2.1 time: 0.295561 Sep 06 01:12:16.015201 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 53/106] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:15 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1322 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:16.020808 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-41b1ba6a-631d-43ee-951f-bc3bce166445 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:16.022645 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-41b1ba6a-631d-43ee-951f-bc3bce166445 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:16.024200 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-41b1ba6a-631d-43ee-951f-bc3bce166445 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1408 microversion: 2.20 time: 0.365278 Sep 06 01:12:16.024949 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 54/107] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:12:15 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1408 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:12:16.043010 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-21af400b-3c12-4d0f-8ba9-cc0bf62759dc tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:16.043951 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-21af400b-3c12-4d0f-8ba9-cc0bf62759dc tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] [instance: e19b4dae-fc30-4e15-ad48-d3892ce81801] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:16.057479 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-21af400b-3c12-4d0f-8ba9-cc0bf62759dc tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:16.058358 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-21af400b-3c12-4d0f-8ba9-cc0bf62759dc tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:16.061897 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-21af400b-3c12-4d0f-8ba9-cc0bf62759dc tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:16.063113 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-21af400b-3c12-4d0f-8ba9-cc0bf62759dc tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:16.064629 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-21af400b-3c12-4d0f-8ba9-cc0bf62759dc tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:16.065319 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-21af400b-3c12-4d0f-8ba9-cc0bf62759dc tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:16.172423 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-2a92e55f-bf40-49ef-a00d-a339f7e959d0 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:16.173053 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-2a92e55f-bf40-49ef-a00d-a339f7e959d0 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:16.199341 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2a92e55f-bf40-49ef-a00d-a339f7e959d0 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:16.199890 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2a92e55f-bf40-49ef-a00d-a339f7e959d0 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:16.200335 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2a92e55f-bf40-49ef-a00d-a339f7e959d0 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:16.201052 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2a92e55f-bf40-49ef-a00d-a339f7e959d0 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:16.201587 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2a92e55f-bf40-49ef-a00d-a339f7e959d0 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:16.202206 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2a92e55f-bf40-49ef-a00d-a339f7e959d0 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:16.257888 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell1:SELECT=100 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:16.332145 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-21af400b-3c12-4d0f-8ba9-cc0bf62759dc tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0354d80eb898418fae8acf8baf4894b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2002558f3d814b1b892ca2d22ff25f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:16.345265 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-21af400b-3c12-4d0f-8ba9-cc0bf62759dc tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] 10.222.0.23 "GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801" status: 200 len: 1314 microversion: 2.1 time: 0.312294 Sep 06 01:12:16.349806 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 54/108] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:16 2022] GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:16.431827 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-2a92e55f-bf40-49ef-a00d-a339f7e959d0 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:16.446587 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-2a92e55f-bf40-49ef-a00d-a339f7e959d0 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e" status: 200 len: 1368 microversion: 2.1 time: 0.275855 Sep 06 01:12:16.448343 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 55/109] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:16 2022] GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e => generated 1368 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:12:17.051698 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4f4d51a0-0918-40c4-af80-355ad363316a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:17.053446 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4f4d51a0-0918-40c4-af80-355ad363316a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:17.061705 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-c29b1711-f8d5-412f-a746-d35e3b2a617c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:17.062477 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f4d51a0-0918-40c4-af80-355ad363316a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:17.063155 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f4d51a0-0918-40c4-af80-355ad363316a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:17.063732 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f4d51a0-0918-40c4-af80-355ad363316a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:17.064192 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-c29b1711-f8d5-412f-a746-d35e3b2a617c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:17.064821 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f4d51a0-0918-40c4-af80-355ad363316a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:17.065826 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f4d51a0-0918-40c4-af80-355ad363316a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:17.066406 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f4d51a0-0918-40c4-af80-355ad363316a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:17.076281 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c29b1711-f8d5-412f-a746-d35e3b2a617c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:17.077775 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c29b1711-f8d5-412f-a746-d35e3b2a617c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:17.078327 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c29b1711-f8d5-412f-a746-d35e3b2a617c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:17.079789 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c29b1711-f8d5-412f-a746-d35e3b2a617c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:17.081054 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c29b1711-f8d5-412f-a746-d35e3b2a617c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:17.081690 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c29b1711-f8d5-412f-a746-d35e3b2a617c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:17.126410 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:17.439303 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-c29b1711-f8d5-412f-a746-d35e3b2a617c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:17.446000 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-4f4d51a0-0918-40c4-af80-355ad363316a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:17.448506 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-c29b1711-f8d5-412f-a746-d35e3b2a617c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:17.450140 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-c29b1711-f8d5-412f-a746-d35e3b2a617c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:17.451247 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-c29b1711-f8d5-412f-a746-d35e3b2a617c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1408 microversion: 2.20 time: 0.399465 Sep 06 01:12:17.452384 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 56/110] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:12:17 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1408 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:12:17.456273 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4f4d51a0-0918-40c4-af80-355ad363316a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1322 microversion: 2.1 time: 0.410031 Sep 06 01:12:17.460435 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-c21a53eb-9c04-4f86-953f-58e8fb46adb8 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:17.461475 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-c21a53eb-9c04-4f86-953f-58e8fb46adb8 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] [instance: e19b4dae-fc30-4e15-ad48-d3892ce81801] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:17.468476 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 55/111] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:17 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1322 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:17.476968 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c21a53eb-9c04-4f86-953f-58e8fb46adb8 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:17.478611 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c21a53eb-9c04-4f86-953f-58e8fb46adb8 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:17.479357 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c21a53eb-9c04-4f86-953f-58e8fb46adb8 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:17.480117 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c21a53eb-9c04-4f86-953f-58e8fb46adb8 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:17.481033 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c21a53eb-9c04-4f86-953f-58e8fb46adb8 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:17.481520 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c21a53eb-9c04-4f86-953f-58e8fb46adb8 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:17.483587 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6e2c3b6b-b757-4308-86ee-9a5c61ac254a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:17.485009 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6e2c3b6b-b757-4308-86ee-9a5c61ac254a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:17.491548 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e2c3b6b-b757-4308-86ee-9a5c61ac254a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:17.492733 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e2c3b6b-b757-4308-86ee-9a5c61ac254a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:17.493493 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e2c3b6b-b757-4308-86ee-9a5c61ac254a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:17.494849 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e2c3b6b-b757-4308-86ee-9a5c61ac254a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:17.495664 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e2c3b6b-b757-4308-86ee-9a5c61ac254a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:17.496337 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e2c3b6b-b757-4308-86ee-9a5c61ac254a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:17.768310 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-c21a53eb-9c04-4f86-953f-58e8fb46adb8 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0354d80eb898418fae8acf8baf4894b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2002558f3d814b1b892ca2d22ff25f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:17.776466 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-c21a53eb-9c04-4f86-953f-58e8fb46adb8 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] 10.222.0.23 "GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801" status: 200 len: 1314 microversion: 2.1 time: 0.322386 Sep 06 01:12:17.777042 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 57/112] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:17 2022] GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801 => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:17.797960 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-6e2c3b6b-b757-4308-86ee-9a5c61ac254a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:17.807605 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6e2c3b6b-b757-4308-86ee-9a5c61ac254a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e" status: 200 len: 1368 microversion: 2.1 time: 0.334648 Sep 06 01:12:17.808405 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 56/113] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:17 2022] GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e => generated 1368 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:17.828832 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-775feb59-3b58-446e-a75d-f8bf644fa77f req-d4e64dfc-1a51-4358-b43b-b02534daebb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e", "name": "network-vif-plugged", "status": "completed", "tag": "cfd96f2a-f172-4913-9442-dad937b6c973"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:12:17.840073 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-775feb59-3b58-446e-a75d-f8bf644fa77f req-d4e64dfc-1a51-4358-b43b-b02534daebb8 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:17.841050 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-775feb59-3b58-446e-a75d-f8bf644fa77f req-d4e64dfc-1a51-4358-b43b-b02534daebb8 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:17.841631 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-775feb59-3b58-446e-a75d-f8bf644fa77f req-d4e64dfc-1a51-4358-b43b-b02534daebb8 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:17.856208 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.compute.server_external_events [req-775feb59-3b58-446e-a75d-f8bf644fa77f req-d4e64dfc-1a51-4358-b43b-b02534daebb8 service nova] Creating event network-vif-plugged:cfd96f2a-f172-4913-9442-dad937b6c973 for instance b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e on hv-cinder-84773 Sep 06 01:12:17.863160 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [req-775feb59-3b58-446e-a75d-f8bf644fa77f req-d4e64dfc-1a51-4358-b43b-b02534daebb8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037492 Sep 06 01:12:17.864061 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 58/114] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:12:18.480884 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e53313c6-aea6-4267-a3cf-61c16f85a6c6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:18.481505 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e53313c6-aea6-4267-a3cf-61c16f85a6c6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:18.482388 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-1c5f973e-8d49-44e6-9569-21e11cdad395 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:18.483578 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-1c5f973e-8d49-44e6-9569-21e11cdad395 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:18.488587 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e53313c6-aea6-4267-a3cf-61c16f85a6c6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:18.489295 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e53313c6-aea6-4267-a3cf-61c16f85a6c6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:18.489879 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e53313c6-aea6-4267-a3cf-61c16f85a6c6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:18.490279 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1c5f973e-8d49-44e6-9569-21e11cdad395 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:18.490770 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1c5f973e-8d49-44e6-9569-21e11cdad395 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:18.491243 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e53313c6-aea6-4267-a3cf-61c16f85a6c6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:18.491356 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1c5f973e-8d49-44e6-9569-21e11cdad395 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:18.492612 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e53313c6-aea6-4267-a3cf-61c16f85a6c6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:18.492778 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1c5f973e-8d49-44e6-9569-21e11cdad395 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:18.493321 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e53313c6-aea6-4267-a3cf-61c16f85a6c6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:18.493450 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1c5f973e-8d49-44e6-9569-21e11cdad395 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:18.493766 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1c5f973e-8d49-44e6-9569-21e11cdad395 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:18.761589 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-1c5f973e-8d49-44e6-9569-21e11cdad395 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:18.771239 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-1c5f973e-8d49-44e6-9569-21e11cdad395 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1322 microversion: 2.1 time: 0.294400 Sep 06 01:12:18.771883 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 59/115] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:18 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:18.805581 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-e53313c6-aea6-4267-a3cf-61c16f85a6c6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:18.807484 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-824da1ba-5f39-4193-b5d8-f9301990c4f3 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:18.809383 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-824da1ba-5f39-4193-b5d8-f9301990c4f3 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] [instance: e19b4dae-fc30-4e15-ad48-d3892ce81801] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:18.820531 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-824da1ba-5f39-4193-b5d8-f9301990c4f3 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:18.821131 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-824da1ba-5f39-4193-b5d8-f9301990c4f3 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:18.821704 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-824da1ba-5f39-4193-b5d8-f9301990c4f3 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:18.823612 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-824da1ba-5f39-4193-b5d8-f9301990c4f3 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:18.824703 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-824da1ba-5f39-4193-b5d8-f9301990c4f3 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:18.825248 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-824da1ba-5f39-4193-b5d8-f9301990c4f3 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:18.829416 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-e53313c6-aea6-4267-a3cf-61c16f85a6c6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:18.831500 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-e53313c6-aea6-4267-a3cf-61c16f85a6c6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:18.832736 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e53313c6-aea6-4267-a3cf-61c16f85a6c6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1408 microversion: 2.20 time: 0.356675 Sep 06 01:12:18.850018 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 57/116] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:12:18 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1408 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:12:18.854577 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-855ea765-1aac-4906-b73c-14235296778a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:18.855199 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-855ea765-1aac-4906-b73c-14235296778a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:18.882638 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-855ea765-1aac-4906-b73c-14235296778a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:18.886871 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-855ea765-1aac-4906-b73c-14235296778a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:18.887339 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-855ea765-1aac-4906-b73c-14235296778a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:18.889826 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-855ea765-1aac-4906-b73c-14235296778a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:18.890298 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-855ea765-1aac-4906-b73c-14235296778a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:18.890731 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-855ea765-1aac-4906-b73c-14235296778a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:19.141665 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-855ea765-1aac-4906-b73c-14235296778a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:19.150553 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-855ea765-1aac-4906-b73c-14235296778a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e" status: 200 len: 1368 microversion: 2.1 time: 0.309901 Sep 06 01:12:19.151180 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 58/117] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:18 2022] GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e => generated 1368 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:19.155039 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-824da1ba-5f39-4193-b5d8-f9301990c4f3 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0354d80eb898418fae8acf8baf4894b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2002558f3d814b1b892ca2d22ff25f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:19.162819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-824da1ba-5f39-4193-b5d8-f9301990c4f3 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] 10.222.0.23 "GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801" status: 200 len: 1314 microversion: 2.1 time: 0.363698 Sep 06 01:12:19.164430 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 60/118] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:18 2022] GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801 => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:19.794897 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8bfad50f-e7dc-4d81-8f03-9251d21c4465 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:19.796405 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8bfad50f-e7dc-4d81-8f03-9251d21c4465 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:19.803552 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8bfad50f-e7dc-4d81-8f03-9251d21c4465 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:19.804984 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8bfad50f-e7dc-4d81-8f03-9251d21c4465 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:19.805686 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8bfad50f-e7dc-4d81-8f03-9251d21c4465 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:19.806810 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8bfad50f-e7dc-4d81-8f03-9251d21c4465 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:19.807470 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8bfad50f-e7dc-4d81-8f03-9251d21c4465 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:19.808113 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8bfad50f-e7dc-4d81-8f03-9251d21c4465 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:19.857803 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-375d4a4a-ee0e-482e-aa8f-998f034bfe1f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:19.859041 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-375d4a4a-ee0e-482e-aa8f-998f034bfe1f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:19.869148 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-375d4a4a-ee0e-482e-aa8f-998f034bfe1f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:19.870012 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-375d4a4a-ee0e-482e-aa8f-998f034bfe1f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:19.872587 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-375d4a4a-ee0e-482e-aa8f-998f034bfe1f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:19.875399 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-375d4a4a-ee0e-482e-aa8f-998f034bfe1f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:19.876277 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-375d4a4a-ee0e-482e-aa8f-998f034bfe1f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:19.876868 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-375d4a4a-ee0e-482e-aa8f-998f034bfe1f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:20.103001 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-8bfad50f-e7dc-4d81-8f03-9251d21c4465 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:20.113756 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8bfad50f-e7dc-4d81-8f03-9251d21c4465 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1322 microversion: 2.1 time: 0.323520 Sep 06 01:12:20.114329 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 59/119] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:19 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1322 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:20.156698 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-375d4a4a-ee0e-482e-aa8f-998f034bfe1f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:20.171361 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-375d4a4a-ee0e-482e-aa8f-998f034bfe1f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:20.173171 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-375d4a4a-ee0e-482e-aa8f-998f034bfe1f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:20.174554 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ffa8ef10-0230-44c0-93e4-bee9772767f3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:20.175222 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ffa8ef10-0230-44c0-93e4-bee9772767f3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:20.175684 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-375d4a4a-ee0e-482e-aa8f-998f034bfe1f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1408 microversion: 2.20 time: 0.321228 Sep 06 01:12:20.176461 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 61/120] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:12:19 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1408 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:12:20.183221 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ffa8ef10-0230-44c0-93e4-bee9772767f3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:20.183973 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ffa8ef10-0230-44c0-93e4-bee9772767f3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:20.187496 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ffa8ef10-0230-44c0-93e4-bee9772767f3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:20.188448 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ffa8ef10-0230-44c0-93e4-bee9772767f3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:20.189049 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ffa8ef10-0230-44c0-93e4-bee9772767f3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:20.189612 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ffa8ef10-0230-44c0-93e4-bee9772767f3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:20.193053 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-1f3aa989-82b7-420a-99e7-e57954eed45e tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:20.194584 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-1f3aa989-82b7-420a-99e7-e57954eed45e tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] [instance: e19b4dae-fc30-4e15-ad48-d3892ce81801] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:20.209777 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1f3aa989-82b7-420a-99e7-e57954eed45e tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:20.210402 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1f3aa989-82b7-420a-99e7-e57954eed45e tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:20.212218 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1f3aa989-82b7-420a-99e7-e57954eed45e tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:20.213447 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1f3aa989-82b7-420a-99e7-e57954eed45e tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:20.215321 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1f3aa989-82b7-420a-99e7-e57954eed45e tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:20.215889 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1f3aa989-82b7-420a-99e7-e57954eed45e tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:20.577841 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-ffa8ef10-0230-44c0-93e4-bee9772767f3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:20.589936 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ffa8ef10-0230-44c0-93e4-bee9772767f3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e" status: 200 len: 1368 microversion: 2.1 time: 0.416076 Sep 06 01:12:20.611078 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 60/121] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:20 2022] GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e => generated 1368 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:20.619791 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-f5f4fad4-38a1-44ff-968a-7074d5e2f654 req-7a14d5bc-0bd5-49ee-8350-c609c82ee090 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c42df4ca-a678-4b12-b5dc-3f3c0af93125", "name": "network-vif-plugged", "status": "completed", "tag": "9f5084ac-bd14-44b7-bba5-06b59fd5291e"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:12:20.635960 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-f5f4fad4-38a1-44ff-968a-7074d5e2f654 req-7a14d5bc-0bd5-49ee-8350-c609c82ee090 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:20.636723 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-f5f4fad4-38a1-44ff-968a-7074d5e2f654 req-7a14d5bc-0bd5-49ee-8350-c609c82ee090 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:20.637860 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-f5f4fad4-38a1-44ff-968a-7074d5e2f654 req-7a14d5bc-0bd5-49ee-8350-c609c82ee090 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:20.653699 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-f5f4fad4-38a1-44ff-968a-7074d5e2f654 req-7a14d5bc-0bd5-49ee-8350-c609c82ee090 service nova] Creating event network-vif-plugged:9f5084ac-bd14-44b7-bba5-06b59fd5291e for instance c42df4ca-a678-4b12-b5dc-3f3c0af93125 on hv-cinder-84773 Sep 06 01:12:20.660296 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-f5f4fad4-38a1-44ff-968a-7074d5e2f654 req-7a14d5bc-0bd5-49ee-8350-c609c82ee090 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046945 Sep 06 01:12:20.661504 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 61/122] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:12:20.662911 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-1f3aa989-82b7-420a-99e7-e57954eed45e tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0354d80eb898418fae8acf8baf4894b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2002558f3d814b1b892ca2d22ff25f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:20.670868 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-1f3aa989-82b7-420a-99e7-e57954eed45e tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] 10.222.0.23 "GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801" status: 200 len: 1500 microversion: 2.1 time: 0.487682 Sep 06 01:12:20.688634 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 62/123] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:20 2022] GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801 => generated 1500 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:21.138910 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4bafe81f-5842-4f1b-b5bd-eb4d81461e77 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:21.140722 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4bafe81f-5842-4f1b-b5bd-eb4d81461e77 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:21.156317 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4bafe81f-5842-4f1b-b5bd-eb4d81461e77 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:21.157146 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4bafe81f-5842-4f1b-b5bd-eb4d81461e77 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:21.157727 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4bafe81f-5842-4f1b-b5bd-eb4d81461e77 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:21.158649 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4bafe81f-5842-4f1b-b5bd-eb4d81461e77 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:21.159372 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4bafe81f-5842-4f1b-b5bd-eb4d81461e77 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:21.159970 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4bafe81f-5842-4f1b-b5bd-eb4d81461e77 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:21.206468 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-e05aab13-885c-4c58-bc2a-62804d11bc07 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:21.207073 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-e05aab13-885c-4c58-bc2a-62804d11bc07 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:21.236425 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e05aab13-885c-4c58-bc2a-62804d11bc07 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:21.236964 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e05aab13-885c-4c58-bc2a-62804d11bc07 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:21.238275 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e05aab13-885c-4c58-bc2a-62804d11bc07 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:21.243012 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e05aab13-885c-4c58-bc2a-62804d11bc07 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:21.245644 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e05aab13-885c-4c58-bc2a-62804d11bc07 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:21.246871 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e05aab13-885c-4c58-bc2a-62804d11bc07 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:21.643682 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-4bafe81f-5842-4f1b-b5bd-eb4d81461e77 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:21.653489 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4bafe81f-5842-4f1b-b5bd-eb4d81461e77 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1322 microversion: 2.1 time: 0.519724 Sep 06 01:12:21.656020 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 62/124] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:21 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1322 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:21.660747 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1df251f3-dc26-4ac4-93ad-3753eccdf219 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:21.661041 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-e05aab13-885c-4c58-bc2a-62804d11bc07 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:21.661841 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1df251f3-dc26-4ac4-93ad-3753eccdf219 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:21.669991 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1df251f3-dc26-4ac4-93ad-3753eccdf219 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:21.670277 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-e05aab13-885c-4c58-bc2a-62804d11bc07 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:21.670966 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1df251f3-dc26-4ac4-93ad-3753eccdf219 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:21.671614 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1df251f3-dc26-4ac4-93ad-3753eccdf219 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:21.671719 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-e05aab13-885c-4c58-bc2a-62804d11bc07 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:21.672701 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1df251f3-dc26-4ac4-93ad-3753eccdf219 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:21.672807 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-e05aab13-885c-4c58-bc2a-62804d11bc07 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1408 microversion: 2.20 time: 0.471573 Sep 06 01:12:21.684001 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 63/125] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:12:21 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1408 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:12:21.684808 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1df251f3-dc26-4ac4-93ad-3753eccdf219 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:21.685565 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1df251f3-dc26-4ac4-93ad-3753eccdf219 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:21.881206 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-1df251f3-dc26-4ac4-93ad-3753eccdf219 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:21.893384 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1df251f3-dc26-4ac4-93ad-3753eccdf219 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e" status: 200 len: 1559 microversion: 2.1 time: 0.235978 Sep 06 01:12:21.894252 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 63/126] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:21 2022] GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e => generated 1559 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:21.926577 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-94e82f29-57c4-4a44-ac12-e5a9f145ad38 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:21.927478 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-94e82f29-57c4-4a44-ac12-e5a9f145ad38 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:21.938551 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-94e82f29-57c4-4a44-ac12-e5a9f145ad38 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:21.939136 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-94e82f29-57c4-4a44-ac12-e5a9f145ad38 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:21.939637 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-94e82f29-57c4-4a44-ac12-e5a9f145ad38 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:21.940489 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-94e82f29-57c4-4a44-ac12-e5a9f145ad38 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:21.941208 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-94e82f29-57c4-4a44-ac12-e5a9f145ad38 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:21.941589 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-94e82f29-57c4-4a44-ac12-e5a9f145ad38 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:22.134494 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-94e82f29-57c4-4a44-ac12-e5a9f145ad38 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.215959 Sep 06 01:12:22.143068 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 64/127] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Sep 6 01:12:21 2022] GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e/os-interface => generated 285 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 01:12:22.446548 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5c7bda78-d23f-4f75-9c0e-c8215fc2b62c tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1cdd54d-a2fc-431c-b801-11b1fa75d126"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:12:22.450222 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5c7bda78-d23f-4f75-9c0e-c8215fc2b62c tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] [instance: e19b4dae-fc30-4e15-ad48-d3892ce81801] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:22.457648 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5c7bda78-d23f-4f75-9c0e-c8215fc2b62c tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:22.458204 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5c7bda78-d23f-4f75-9c0e-c8215fc2b62c tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:22.458849 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5c7bda78-d23f-4f75-9c0e-c8215fc2b62c tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:22.459797 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5c7bda78-d23f-4f75-9c0e-c8215fc2b62c tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:22.460599 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5c7bda78-d23f-4f75-9c0e-c8215fc2b62c tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:22.461282 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5c7bda78-d23f-4f75-9c0e-c8215fc2b62c tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:22.688316 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-ab4eec31-5ce3-4a87-b8f6-377a0757dc07 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:22.689000 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-ab4eec31-5ce3-4a87-b8f6-377a0757dc07 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:22.697307 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ab4eec31-5ce3-4a87-b8f6-377a0757dc07 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:22.697797 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ab4eec31-5ce3-4a87-b8f6-377a0757dc07 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:22.698828 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ab4eec31-5ce3-4a87-b8f6-377a0757dc07 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:22.701599 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ab4eec31-5ce3-4a87-b8f6-377a0757dc07 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:22.702405 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ab4eec31-5ce3-4a87-b8f6-377a0757dc07 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:22.702837 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ab4eec31-5ce3-4a87-b8f6-377a0757dc07 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:23.066117 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-ab4eec31-5ce3-4a87-b8f6-377a0757dc07 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:23.077667 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-ab4eec31-5ce3-4a87-b8f6-377a0757dc07 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1322 microversion: 2.1 time: 0.394429 Sep 06 01:12:23.078538 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 65/128] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:22 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1322 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:23.086113 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-eca0f0c7-15dd-48c8-8fdc-42bd9bd1a6d7 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:23.086952 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-eca0f0c7-15dd-48c8-8fdc-42bd9bd1a6d7 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:23.102392 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-eca0f0c7-15dd-48c8-8fdc-42bd9bd1a6d7 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:23.103457 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-eca0f0c7-15dd-48c8-8fdc-42bd9bd1a6d7 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:23.105431 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-eca0f0c7-15dd-48c8-8fdc-42bd9bd1a6d7 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:23.107683 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-eca0f0c7-15dd-48c8-8fdc-42bd9bd1a6d7 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:23.108440 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-eca0f0c7-15dd-48c8-8fdc-42bd9bd1a6d7 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:23.109451 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-eca0f0c7-15dd-48c8-8fdc-42bd9bd1a6d7 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:23.420087 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5c7bda78-d23f-4f75-9c0e-c8215fc2b62c tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] 10.222.0.23 "POST /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.978020 Sep 06 01:12:23.425437 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 64/129] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Sep 6 01:12:22 2022] POST /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801/os-volume_attachments => generated 194 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:12:23.434487 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-707bda02-e649-43c1-9571-266e806b338b req-c009311f-23a0-41f6-9248-43a29edd8a0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88683beb-47e8-46e9-af24-4098c50a674a", "name": "network-vif-plugged", "status": "completed", "tag": "1453654f-e3a0-4c17-8fd8-4d6102d43d13"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:12:23.446240 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-707bda02-e649-43c1-9571-266e806b338b req-c009311f-23a0-41f6-9248-43a29edd8a0c service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:23.446734 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-707bda02-e649-43c1-9571-266e806b338b req-c009311f-23a0-41f6-9248-43a29edd8a0c service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:23.448508 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-707bda02-e649-43c1-9571-266e806b338b req-c009311f-23a0-41f6-9248-43a29edd8a0c service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:23.463387 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-707bda02-e649-43c1-9571-266e806b338b req-c009311f-23a0-41f6-9248-43a29edd8a0c service nova] Creating event network-vif-plugged:1453654f-e3a0-4c17-8fd8-4d6102d43d13 for instance 88683beb-47e8-46e9-af24-4098c50a674a on hv-cinder-84773 Sep 06 01:12:23.469305 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-707bda02-e649-43c1-9571-266e806b338b req-c009311f-23a0-41f6-9248-43a29edd8a0c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041838 Sep 06 01:12:23.470063 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 65/130] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:12:23.774165 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-eca0f0c7-15dd-48c8-8fdc-42bd9bd1a6d7 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:23.782744 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-eca0f0c7-15dd-48c8-8fdc-42bd9bd1a6d7 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:23.789181 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-eca0f0c7-15dd-48c8-8fdc-42bd9bd1a6d7 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:23.790387 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-eca0f0c7-15dd-48c8-8fdc-42bd9bd1a6d7 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1408 microversion: 2.20 time: 0.710756 Sep 06 01:12:23.794087 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 66/131] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:12:23 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1408 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:12:24.107652 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1be2d2e5-4b19-4c47-9c51-776dbe48f706 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:24.108656 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1be2d2e5-4b19-4c47-9c51-776dbe48f706 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:24.116470 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1be2d2e5-4b19-4c47-9c51-776dbe48f706 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:24.116635 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1be2d2e5-4b19-4c47-9c51-776dbe48f706 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:24.118414 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1be2d2e5-4b19-4c47-9c51-776dbe48f706 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:24.119958 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1be2d2e5-4b19-4c47-9c51-776dbe48f706 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:24.120766 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1be2d2e5-4b19-4c47-9c51-776dbe48f706 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:24.121339 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1be2d2e5-4b19-4c47-9c51-776dbe48f706 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:24.409500 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-b926bfea-4b6c-46bd-8969-a9a4b3aa2744 req-049e3ff4-8474-4813-b804-b8ef101122f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e", "tag": "cfd96f2a-f172-4913-9442-dad937b6c973"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:12:24.431269 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-b926bfea-4b6c-46bd-8969-a9a4b3aa2744 req-049e3ff4-8474-4813-b804-b8ef101122f2 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:24.434448 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-b926bfea-4b6c-46bd-8969-a9a4b3aa2744 req-049e3ff4-8474-4813-b804-b8ef101122f2 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:24.436171 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-b926bfea-4b6c-46bd-8969-a9a4b3aa2744 req-049e3ff4-8474-4813-b804-b8ef101122f2 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:24.477006 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.compute.server_external_events [req-b926bfea-4b6c-46bd-8969-a9a4b3aa2744 req-049e3ff4-8474-4813-b804-b8ef101122f2 service nova] Creating event network-changed:cfd96f2a-f172-4913-9442-dad937b6c973 for instance b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e on hv-cinder-84773 Sep 06 01:12:24.486034 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [req-b926bfea-4b6c-46bd-8969-a9a4b3aa2744 req-049e3ff4-8474-4813-b804-b8ef101122f2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080853 Sep 06 01:12:24.489232 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 67/132] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:12:24.491615 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-1be2d2e5-4b19-4c47-9c51-776dbe48f706 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:24.500243 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1be2d2e5-4b19-4c47-9c51-776dbe48f706 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1322 microversion: 2.1 time: 0.397824 Sep 06 01:12:24.503408 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 66/133] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:24 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1322 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:24.819256 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-bd1e7734-0738-44e5-bf48-ac7cd28178a2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:24.820571 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-bd1e7734-0738-44e5-bf48-ac7cd28178a2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:24.830352 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-bd1e7734-0738-44e5-bf48-ac7cd28178a2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:24.830858 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-bd1e7734-0738-44e5-bf48-ac7cd28178a2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:24.831298 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-bd1e7734-0738-44e5-bf48-ac7cd28178a2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:24.832037 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-bd1e7734-0738-44e5-bf48-ac7cd28178a2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:24.832496 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-bd1e7734-0738-44e5-bf48-ac7cd28178a2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:24.832925 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-bd1e7734-0738-44e5-bf48-ac7cd28178a2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:25.081778 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-bd1e7734-0738-44e5-bf48-ac7cd28178a2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:25.094348 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-bd1e7734-0738-44e5-bf48-ac7cd28178a2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:25.098360 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-bd1e7734-0738-44e5-bf48-ac7cd28178a2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:25.100785 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-bd1e7734-0738-44e5-bf48-ac7cd28178a2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1599 microversion: 2.20 time: 0.285422 Sep 06 01:12:25.124953 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 68/134] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:12:24 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1599 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:12:25.135440 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-181344a5-b0b9-4289-895d-d26ccc0a4205 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:25.136071 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-181344a5-b0b9-4289-895d-d26ccc0a4205 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:25.150357 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-181344a5-b0b9-4289-895d-d26ccc0a4205 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:25.153165 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-181344a5-b0b9-4289-895d-d26ccc0a4205 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:25.153651 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-181344a5-b0b9-4289-895d-d26ccc0a4205 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:25.156635 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-181344a5-b0b9-4289-895d-d26ccc0a4205 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:25.157258 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-181344a5-b0b9-4289-895d-d26ccc0a4205 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:25.161953 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-181344a5-b0b9-4289-895d-d26ccc0a4205 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:25.318998 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-181344a5-b0b9-4289-895d-d26ccc0a4205 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.193666 Sep 06 01:12:25.320452 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 67/135] 10.222.0.23 () {60 vars in 1316 bytes} [Tue Sep 6 01:12:25 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125/os-interface => generated 284 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 01:12:25.530040 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-2f31e262-a1e9-4a50-86ec-5f3dc61d3b7d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:25.531907 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-2f31e262-a1e9-4a50-86ec-5f3dc61d3b7d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:25.547806 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2f31e262-a1e9-4a50-86ec-5f3dc61d3b7d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:25.550311 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2f31e262-a1e9-4a50-86ec-5f3dc61d3b7d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:25.552516 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2f31e262-a1e9-4a50-86ec-5f3dc61d3b7d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:25.556093 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2f31e262-a1e9-4a50-86ec-5f3dc61d3b7d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:25.556839 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2f31e262-a1e9-4a50-86ec-5f3dc61d3b7d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:25.564182 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2f31e262-a1e9-4a50-86ec-5f3dc61d3b7d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:26.010741 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-2f31e262-a1e9-4a50-86ec-5f3dc61d3b7d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:26.019466 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-2f31e262-a1e9-4a50-86ec-5f3dc61d3b7d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1516 microversion: 2.1 time: 0.498117 Sep 06 01:12:26.051332 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 69/136] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:25 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1516 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:26.060632 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-acbfc9c4-f0be-40d1-a0b6-463fbcbc4d9e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:12:26.064244 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-acbfc9c4-f0be-40d1-a0b6-463fbcbc4d9e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:26.081359 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-acbfc9c4-f0be-40d1-a0b6-463fbcbc4d9e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:26.083920 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-acbfc9c4-f0be-40d1-a0b6-463fbcbc4d9e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:26.084209 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-acbfc9c4-f0be-40d1-a0b6-463fbcbc4d9e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:26.086258 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-acbfc9c4-f0be-40d1-a0b6-463fbcbc4d9e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:26.087512 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-acbfc9c4-f0be-40d1-a0b6-463fbcbc4d9e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:26.090602 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-acbfc9c4-f0be-40d1-a0b6-463fbcbc4d9e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:26.159975 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-acbfc9c4-f0be-40d1-a0b6-463fbcbc4d9e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lazy-loading 'flavor' on Instance uuid 88683beb-47e8-46e9-af24-4098c50a674a {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 01:12:26.438458 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-acbfc9c4-f0be-40d1-a0b6-463fbcbc4d9e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "POST /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a/action" status: 200 len: 32 microversion: 2.1 time: 0.384783 Sep 06 01:12:26.439074 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 68/137] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Sep 6 01:12:26 2022] POST /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a/action => generated 32 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 06 01:12:26.450606 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-3b3a0a6d-15a4-455d-b5a4-7a6d25dc5b65 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:26.451351 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-3b3a0a6d-15a4-455d-b5a4-7a6d25dc5b65 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:26.461404 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3b3a0a6d-15a4-455d-b5a4-7a6d25dc5b65 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:26.462842 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3b3a0a6d-15a4-455d-b5a4-7a6d25dc5b65 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:26.464212 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3b3a0a6d-15a4-455d-b5a4-7a6d25dc5b65 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:26.467676 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3b3a0a6d-15a4-455d-b5a4-7a6d25dc5b65 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:26.468500 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3b3a0a6d-15a4-455d-b5a4-7a6d25dc5b65 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:26.469039 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3b3a0a6d-15a4-455d-b5a4-7a6d25dc5b65 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:26.852890 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-3b3a0a6d-15a4-455d-b5a4-7a6d25dc5b65 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:26.864809 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-3b3a0a6d-15a4-455d-b5a4-7a6d25dc5b65 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1522 microversion: 2.1 time: 0.418331 Sep 06 01:12:26.868763 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 70/138] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:26 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1522 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:27.715251 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-3ccbcdc8-007f-4aad-b6b3-bd17575e787b req-68d1183f-2bb1-4800-b386-c0a17e25fb31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c42df4ca-a678-4b12-b5dc-3f3c0af93125", "tag": "9f5084ac-bd14-44b7-bba5-06b59fd5291e"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:12:27.740938 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3ccbcdc8-007f-4aad-b6b3-bd17575e787b req-68d1183f-2bb1-4800-b386-c0a17e25fb31 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:27.741424 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3ccbcdc8-007f-4aad-b6b3-bd17575e787b req-68d1183f-2bb1-4800-b386-c0a17e25fb31 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:27.741905 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3ccbcdc8-007f-4aad-b6b3-bd17575e787b req-68d1183f-2bb1-4800-b386-c0a17e25fb31 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:27.764396 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-3ccbcdc8-007f-4aad-b6b3-bd17575e787b req-68d1183f-2bb1-4800-b386-c0a17e25fb31 service nova] Creating event network-changed:9f5084ac-bd14-44b7-bba5-06b59fd5291e for instance c42df4ca-a678-4b12-b5dc-3f3c0af93125 on hv-cinder-84773 Sep 06 01:12:27.781502 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-3ccbcdc8-007f-4aad-b6b3-bd17575e787b req-68d1183f-2bb1-4800-b386-c0a17e25fb31 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072025 Sep 06 01:12:27.782523 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 69/139] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:12:27.888656 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-fa556942-903e-4660-a4a3-3b9d0c4745b0 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:27.890345 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-fa556942-903e-4660-a4a3-3b9d0c4745b0 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:27.902476 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fa556942-903e-4660-a4a3-3b9d0c4745b0 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:27.903208 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fa556942-903e-4660-a4a3-3b9d0c4745b0 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:27.905703 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fa556942-903e-4660-a4a3-3b9d0c4745b0 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:27.906604 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fa556942-903e-4660-a4a3-3b9d0c4745b0 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:27.907241 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fa556942-903e-4660-a4a3-3b9d0c4745b0 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:27.909816 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fa556942-903e-4660-a4a3-3b9d0c4745b0 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:28.176712 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-12bdf503-47cc-455d-945c-45646d6f14b6 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:28.177475 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-12bdf503-47cc-455d-945c-45646d6f14b6 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] [instance: e19b4dae-fc30-4e15-ad48-d3892ce81801] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:28.185020 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-12bdf503-47cc-455d-945c-45646d6f14b6 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:28.185733 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-12bdf503-47cc-455d-945c-45646d6f14b6 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:28.186420 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-12bdf503-47cc-455d-945c-45646d6f14b6 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:28.188182 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-12bdf503-47cc-455d-945c-45646d6f14b6 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:28.188843 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-12bdf503-47cc-455d-945c-45646d6f14b6 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:28.190013 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-12bdf503-47cc-455d-945c-45646d6f14b6 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:28.227194 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-12bdf503-47cc-455d-945c-45646d6f14b6 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] [instance: e19b4dae-fc30-4e15-ad48-d3892ce81801] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 01:12:28.265926 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:28.364399 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-fa556942-903e-4660-a4a3-3b9d0c4745b0 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:28.375051 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-fa556942-903e-4660-a4a3-3b9d0c4745b0 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1522 microversion: 2.1 time: 0.490207 Sep 06 01:12:28.385284 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 71/140] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:27 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1522 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:28.441399 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-12bdf503-47cc-455d-945c-45646d6f14b6 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801" status: 204 len: 0 microversion: 2.1 time: 0.273951 Sep 06 01:12:28.444030 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 70/141] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 6 01:12:28 2022] DELETE /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 01:12:28.457682 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-c8e9e660-c193-4817-9b7d-36ee2cf59716 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:28.458409 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-c8e9e660-c193-4817-9b7d-36ee2cf59716 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] [instance: e19b4dae-fc30-4e15-ad48-d3892ce81801] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:28.465049 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c8e9e660-c193-4817-9b7d-36ee2cf59716 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:28.465538 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c8e9e660-c193-4817-9b7d-36ee2cf59716 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:28.466122 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c8e9e660-c193-4817-9b7d-36ee2cf59716 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:28.466826 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c8e9e660-c193-4817-9b7d-36ee2cf59716 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:28.468057 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c8e9e660-c193-4817-9b7d-36ee2cf59716 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:28.468486 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c8e9e660-c193-4817-9b7d-36ee2cf59716 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:28.635579 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-c8e9e660-c193-4817-9b7d-36ee2cf59716 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0354d80eb898418fae8acf8baf4894b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2002558f3d814b1b892ca2d22ff25f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:28.646003 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-c8e9e660-c193-4817-9b7d-36ee2cf59716 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] 10.222.0.23 "GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801" status: 200 len: 1552 microversion: 2.1 time: 0.193520 Sep 06 01:12:28.646591 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 72/142] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:28 2022] GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801 => generated 1552 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:29.411088 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c7984bac-88f0-4808-931a-3f5dfa12fb64 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:29.413791 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c7984bac-88f0-4808-931a-3f5dfa12fb64 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:29.422455 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c7984bac-88f0-4808-931a-3f5dfa12fb64 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:29.422958 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c7984bac-88f0-4808-931a-3f5dfa12fb64 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:29.423399 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c7984bac-88f0-4808-931a-3f5dfa12fb64 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:29.424301 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c7984bac-88f0-4808-931a-3f5dfa12fb64 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:29.424765 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c7984bac-88f0-4808-931a-3f5dfa12fb64 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:29.425247 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c7984bac-88f0-4808-931a-3f5dfa12fb64 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:29.632671 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-c7984bac-88f0-4808-931a-3f5dfa12fb64 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:29.641836 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c7984bac-88f0-4808-931a-3f5dfa12fb64 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1522 microversion: 2.1 time: 0.243582 Sep 06 01:12:29.642263 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 71/143] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:29 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:12:29.672795 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-36ff1ac3-8189-4ebb-becf-cb21565a518f tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:29.674037 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-36ff1ac3-8189-4ebb-becf-cb21565a518f tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] [instance: e19b4dae-fc30-4e15-ad48-d3892ce81801] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:29.687953 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-36ff1ac3-8189-4ebb-becf-cb21565a518f tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:29.688645 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-36ff1ac3-8189-4ebb-becf-cb21565a518f tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:29.690620 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-36ff1ac3-8189-4ebb-becf-cb21565a518f tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:29.691539 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-36ff1ac3-8189-4ebb-becf-cb21565a518f tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:29.692049 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-36ff1ac3-8189-4ebb-becf-cb21565a518f tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:29.694021 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-36ff1ac3-8189-4ebb-becf-cb21565a518f tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:29.729703 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell1:SELECT=100 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:29.894114 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-36ff1ac3-8189-4ebb-becf-cb21565a518f tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0354d80eb898418fae8acf8baf4894b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2002558f3d814b1b892ca2d22ff25f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:29.905466 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-36ff1ac3-8189-4ebb-becf-cb21565a518f tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] 10.222.0.23 "GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801" status: 200 len: 1552 microversion: 2.1 time: 0.237357 Sep 06 01:12:29.906252 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 73/144] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:29 2022] GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801 => generated 1552 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:30.666535 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-eae26189-52e9-48d8-8eb5-e8b1b20cf363 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:30.667278 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-eae26189-52e9-48d8-8eb5-e8b1b20cf363 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:30.676391 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eae26189-52e9-48d8-8eb5-e8b1b20cf363 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:30.680527 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eae26189-52e9-48d8-8eb5-e8b1b20cf363 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:30.683192 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eae26189-52e9-48d8-8eb5-e8b1b20cf363 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:30.685711 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eae26189-52e9-48d8-8eb5-e8b1b20cf363 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:30.686366 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eae26189-52e9-48d8-8eb5-e8b1b20cf363 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:30.687352 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eae26189-52e9-48d8-8eb5-e8b1b20cf363 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:30.882666 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-eae26189-52e9-48d8-8eb5-e8b1b20cf363 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:30.891229 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-eae26189-52e9-48d8-8eb5-e8b1b20cf363 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1522 microversion: 2.1 time: 0.230031 Sep 06 01:12:30.891902 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 72/145] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:30 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:30.931163 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-cf8a4b79-36bf-4f40-8929-bc16a69d844d tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:30.931740 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-cf8a4b79-36bf-4f40-8929-bc16a69d844d tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] [instance: e19b4dae-fc30-4e15-ad48-d3892ce81801] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:30.939849 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cf8a4b79-36bf-4f40-8929-bc16a69d844d tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:30.940601 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cf8a4b79-36bf-4f40-8929-bc16a69d844d tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:30.941128 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cf8a4b79-36bf-4f40-8929-bc16a69d844d tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:30.951106 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cf8a4b79-36bf-4f40-8929-bc16a69d844d tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:30.952061 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cf8a4b79-36bf-4f40-8929-bc16a69d844d tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:30.952918 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cf8a4b79-36bf-4f40-8929-bc16a69d844d tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:31.217717 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-cf8a4b79-36bf-4f40-8929-bc16a69d844d tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0354d80eb898418fae8acf8baf4894b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2002558f3d814b1b892ca2d22ff25f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:31.228333 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-cf8a4b79-36bf-4f40-8929-bc16a69d844d tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] 10.222.0.23 "GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801" status: 200 len: 1552 microversion: 2.1 time: 0.302186 Sep 06 01:12:31.236865 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 74/146] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:30 2022] GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801 => generated 1552 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:12:31.833162 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-dc593381-83f0-453b-ae14-d6bb3e78c901 req-c906b149-eee8-4109-9190-f3188086f5bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e19b4dae-fc30-4e15-ad48-d3892ce81801", "name": "network-vif-deleted", "tag": "32b70eb8-cd96-473d-8902-5e15e8eae911"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:12:31.849239 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-dc593381-83f0-453b-ae14-d6bb3e78c901 req-c906b149-eee8-4109-9190-f3188086f5bd service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:31.849726 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-dc593381-83f0-453b-ae14-d6bb3e78c901 req-c906b149-eee8-4109-9190-f3188086f5bd service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:31.850153 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-dc593381-83f0-453b-ae14-d6bb3e78c901 req-c906b149-eee8-4109-9190-f3188086f5bd service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:31.862743 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-dc593381-83f0-453b-ae14-d6bb3e78c901 req-c906b149-eee8-4109-9190-f3188086f5bd service nova] Creating event network-vif-deleted:32b70eb8-cd96-473d-8902-5e15e8eae911 for instance e19b4dae-fc30-4e15-ad48-d3892ce81801 on hv-cinder-84773 Sep 06 01:12:31.869555 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-dc593381-83f0-453b-ae14-d6bb3e78c901 req-c906b149-eee8-4109-9190-f3188086f5bd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043251 Sep 06 01:12:31.871108 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 73/147] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:12:31.914388 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-29603004-ec9a-4237-aeb1-4dab81e08b90 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:31.915277 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-29603004-ec9a-4237-aeb1-4dab81e08b90 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:31.922520 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-29603004-ec9a-4237-aeb1-4dab81e08b90 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:31.923022 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-29603004-ec9a-4237-aeb1-4dab81e08b90 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:31.923458 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-29603004-ec9a-4237-aeb1-4dab81e08b90 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:31.924187 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-29603004-ec9a-4237-aeb1-4dab81e08b90 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:31.924640 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-29603004-ec9a-4237-aeb1-4dab81e08b90 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:31.925056 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-29603004-ec9a-4237-aeb1-4dab81e08b90 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:32.109765 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-29603004-ec9a-4237-aeb1-4dab81e08b90 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:32.118145 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-29603004-ec9a-4237-aeb1-4dab81e08b90 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1522 microversion: 2.1 time: 0.207625 Sep 06 01:12:32.118718 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 75/148] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:31 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:32.263818 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7423a1d0-7b08-4c28-bbc1-4611f6920863 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:32.265588 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7423a1d0-7b08-4c28-bbc1-4611f6920863 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] [instance: e19b4dae-fc30-4e15-ad48-d3892ce81801] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:32.275479 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7423a1d0-7b08-4c28-bbc1-4611f6920863 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:32.276274 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7423a1d0-7b08-4c28-bbc1-4611f6920863 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:32.276857 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7423a1d0-7b08-4c28-bbc1-4611f6920863 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:32.277819 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7423a1d0-7b08-4c28-bbc1-4611f6920863 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:32.279325 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7423a1d0-7b08-4c28-bbc1-4611f6920863 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:32.279966 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7423a1d0-7b08-4c28-bbc1-4611f6920863 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:32.385143 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-7423a1d0-7b08-4c28-bbc1-4611f6920863 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0354d80eb898418fae8acf8baf4894b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2002558f3d814b1b892ca2d22ff25f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:32.394668 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7423a1d0-7b08-4c28-bbc1-4611f6920863 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] 10.222.0.23 "GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801" status: 200 len: 1345 microversion: 2.1 time: 0.137349 Sep 06 01:12:32.408542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 74/149] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:32 2022] GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801 => generated 1345 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:32.707195 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-72d0b280-1418-4c4c-ba72-35cfeba1e00d tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-539086655", "imageRef": "768973cc-7b5f-4eed-b493-e40eb0de9f88", "flavorRef": "452", "networks": [{"uuid": "78c9ee1a-8290-442d-a129-7d8287d9342b"}]}} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:12:32.760961 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.network.neutron [None req-72d0b280-1418-4c4c-ba72-35cfeba1e00d tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] validate_networks() for [('78c9ee1a-8290-442d-a129-7d8287d9342b', None, None, None, None, None)] {{(pid=120580) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 01:12:33.118918 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-72d0b280-1418-4c4c-ba72-35cfeba1e00d tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Flavor limits 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 01:12:33.119448 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-72d0b280-1418-4c4c-ba72-35cfeba1e00d tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Image limits 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 01:12:33.119834 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-72d0b280-1418-4c4c-ba72-35cfeba1e00d tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Flavor pref 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 01:12:33.120260 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-72d0b280-1418-4c4c-ba72-35cfeba1e00d tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Image pref 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 01:12:33.120653 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-72d0b280-1418-4c4c-ba72-35cfeba1e00d tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 01:12:33.129226 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-72d0b280-1418-4c4c-ba72-35cfeba1e00d tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:33.129703 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-72d0b280-1418-4c4c-ba72-35cfeba1e00d tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:33.130132 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-72d0b280-1418-4c4c-ba72-35cfeba1e00d tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:33.130847 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-72d0b280-1418-4c4c-ba72-35cfeba1e00d tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:33.131297 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-72d0b280-1418-4c4c-ba72-35cfeba1e00d tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:33.131720 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-72d0b280-1418-4c4c-ba72-35cfeba1e00d tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:33.142194 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4126631f-7bde-4d06-90a9-93c38d19a983 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:33.142824 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4126631f-7bde-4d06-90a9-93c38d19a983 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:33.149348 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.quota [None req-72d0b280-1418-4c4c-ba72-35cfeba1e00d tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Getting quotas for project d4d649e0b0434716b8d4aaf4ea171a8e. Resources: {'instances', 'ram', 'cores'} {{(pid=120580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 01:12:33.149602 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4126631f-7bde-4d06-90a9-93c38d19a983 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:33.150075 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4126631f-7bde-4d06-90a9-93c38d19a983 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:33.150502 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4126631f-7bde-4d06-90a9-93c38d19a983 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:33.151178 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4126631f-7bde-4d06-90a9-93c38d19a983 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:33.151625 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4126631f-7bde-4d06-90a9-93c38d19a983 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:33.152062 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4126631f-7bde-4d06-90a9-93c38d19a983 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:33.153453 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.quota [None req-72d0b280-1418-4c4c-ba72-35cfeba1e00d tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Getting quotas for user 2d2b7b4cb4a34964a4d6127a1ed3ac98 and project d4d649e0b0434716b8d4aaf4ea171a8e. Resources: {'instances', 'ram', 'cores'} {{(pid=120580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 01:12:33.164303 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-72d0b280-1418-4c4c-ba72-35cfeba1e00d tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Going to run 1 instances... {{(pid=120580) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 01:12:33.166574 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-72d0b280-1418-4c4c-ba72-35cfeba1e00d tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 7589d872-fdde-4504-b16e-1f16598c41d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='768973cc-7b5f-4eed-b493-e40eb0de9f88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 01:12:33.214533 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-72d0b280-1418-4c4c-ba72-35cfeba1e00d tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.510920 Sep 06 01:12:33.215427 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 76/150] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Sep 6 01:12:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 01:12:33.231067 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-6b502832-d6b0-4ced-8f60-1eb9e7fcc0c7 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:33.231852 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-6b502832-d6b0-4ced-8f60-1eb9e7fcc0c7 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 7589d872-fdde-4504-b16e-1f16598c41d3] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:33.303575 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-6b502832-d6b0-4ced-8f60-1eb9e7fcc0c7 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:33.313127 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-6b502832-d6b0-4ced-8f60-1eb9e7fcc0c7 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/7589d872-fdde-4504-b16e-1f16598c41d3" status: 200 len: 1218 microversion: 2.1 time: 0.087416 Sep 06 01:12:33.314003 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 77/151] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:33 2022] GET /compute/v2.1/servers/7589d872-fdde-4504-b16e-1f16598c41d3 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:33.344358 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-4126631f-7bde-4d06-90a9-93c38d19a983 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:33.352326 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4126631f-7bde-4d06-90a9-93c38d19a983 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1522 microversion: 2.1 time: 0.213840 Sep 06 01:12:33.352896 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 75/152] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:33 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:12:33.421303 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-e3340533-e88f-4dbf-8398-debae491cbcc tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:33.422267 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-e3340533-e88f-4dbf-8398-debae491cbcc tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] [instance: e19b4dae-fc30-4e15-ad48-d3892ce81801] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:33.431505 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e3340533-e88f-4dbf-8398-debae491cbcc tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:33.432322 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e3340533-e88f-4dbf-8398-debae491cbcc tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:33.433041 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e3340533-e88f-4dbf-8398-debae491cbcc tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:33.434366 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e3340533-e88f-4dbf-8398-debae491cbcc tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:33.435383 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e3340533-e88f-4dbf-8398-debae491cbcc tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:33.435844 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e3340533-e88f-4dbf-8398-debae491cbcc tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:33.460646 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.wsgi [None req-e3340533-e88f-4dbf-8398-debae491cbcc tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] HTTP exception thrown: Instance e19b4dae-fc30-4e15-ad48-d3892ce81801 could not be found. Sep 06 01:12:33.466288 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-e3340533-e88f-4dbf-8398-debae491cbcc tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Request method failure captured: Sep 06 01:12:33.466288 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: request: GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801 HTTP/1.1 Sep 06 01:12:33.466288 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept: application/json Sep 06 01:12:33.466288 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept-Encoding: identity Sep 06 01:12:33.466288 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Connection: close Sep 06 01:12:33.466288 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Length: 0 Sep 06 01:12:33.466288 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Type: application/json Sep 06 01:12:33.466288 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Host: 10.222.0.23 Sep 06 01:12:33.466288 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Openstack-System-Scope: None Sep 06 01:12:33.466288 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: User-Agent: python-urllib3/1.26.12 Sep 06 01:12:33.466288 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Auth-Token: gAAAAABjFp5Mn5Xa7JWSTmJefVHWY5l38xpScJfwPmAzkBo2VaLQn4eK8o9TEnX7-EwUT61n5977l6G8yIJMgbYSIKHoNLYZsCp-KbdUsAut8AHXqAoHrGWYwWndRQhN0rRRS3psQ1s8CrEW_kfSxPwE43ttc5FSU6VS4dZfemIIDBmeQNe6ZMo Sep 06 01:12:33.466288 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Id: None Sep 06 01:12:33.466288 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Name: None Sep 06 01:12:33.466288 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Identity-Status: Confirmed Sep 06 01:12:33.466288 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Is-Admin-Project: True Sep 06 01:12:33.466288 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Id: default Sep 06 01:12:33.466288 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Name: Default Sep 06 01:12:33.466288 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Id: 2002558f3d814b1b892ca2d22ff25f05 Sep 06 01:12:33.466288 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Name: tempest-DeleteServersTestJSON-1575745062 Sep 06 01:12:33.466288 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Role: reader,member Sep 06 01:12:33.466288 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Roles: reader,member Sep 06 01:12:33.467527 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2002558f3d814b1b892ca2d22ff25f05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2002558f3d814b1b892ca2d22ff25f05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2002558f3d814b1b892ca2d22ff25f05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2002558f3d814b1b892ca2d22ff25f05"}]}] Sep 06 01:12:33.467527 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant: tempest-DeleteServersTestJSON-1575745062 Sep 06 01:12:33.467527 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Id: 2002558f3d814b1b892ca2d22ff25f05 Sep 06 01:12:33.467527 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Name: tempest-DeleteServersTestJSON-1575745062 Sep 06 01:12:33.467527 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User: tempest-DeleteServersTestJSON-1575745062-project Sep 06 01:12:33.467527 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Id: default Sep 06 01:12:33.467527 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Name: Default Sep 06 01:12:33.467527 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Id: 0354d80eb898418fae8acf8baf4894b1 Sep 06 01:12:33.467527 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Name: tempest-DeleteServersTestJSON-1575745062-project Sep 06 01:12:33.467527 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: method: > Sep 06 01:12:33.467527 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: exception: Instance e19b4dae-fc30-4e15-ad48-d3892ce81801 could not be found. Sep 06 01:12:33.467527 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: action_args: {'id': 'e19b4dae-fc30-4e15-ad48-d3892ce81801'} Sep 06 01:12:33.468779 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:12:33.468779 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:12:33.468779 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 01:12:33.468779 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 01:12:33.468779 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 01:12:33.468779 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 01:12:33.468779 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 01:12:33.468779 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 01:12:33.468779 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 01:12:33.468779 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 01:12:33.468779 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e19b4dae-fc30-4e15-ad48-d3892ce81801 could not be found. Sep 06 01:12:33.468779 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:12:33.468779 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:12:33.468779 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:12:33.468779 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:12:33.468779 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:12:33.468779 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:12:33.468779 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:12:33.468779 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:12:33.468779 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:12:33.470796 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:12:33.470796 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 01:12:33.470796 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 01:12:33.470796 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 01:12:33.470796 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 01:12:33.470796 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 01:12:33.470796 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:12:33.470796 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e19b4dae-fc30-4e15-ad48-d3892ce81801 could not be found. Sep 06 01:12:33.470796 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:12:33.470796 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:12:33.470796 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:12:33.470796 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:12:33.470796 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:12:33.470796 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:12:33.470796 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:12:33.470796 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:12:33.470796 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e19b4dae-fc30-4e15-ad48-d3892ce81801 could not be found. Sep 06 01:12:33.470796 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:12:33.472896 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-e3340533-e88f-4dbf-8398-debae491cbcc tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Returning 404 to user: Instance e19b4dae-fc30-4e15-ad48-d3892ce81801 could not be found. {{(pid=120580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:12:33.472896 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-e3340533-e88f-4dbf-8398-debae491cbcc tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] 10.222.0.23 "GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801" status: 404 len: 111 microversion: 2.1 time: 0.051744 Sep 06 01:12:33.472896 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 78/153] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:33 2022] GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 01:12:33.741053 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dccb4080-d7ca-40ca-a0b4-ab8ec9c62b68 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:33.748687 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-dccb4080-d7ca-40ca-a0b4-ab8ec9c62b68 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] [instance: e19b4dae-fc30-4e15-ad48-d3892ce81801] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:33.766501 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dccb4080-d7ca-40ca-a0b4-ab8ec9c62b68 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:33.767342 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dccb4080-d7ca-40ca-a0b4-ab8ec9c62b68 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:33.768005 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dccb4080-d7ca-40ca-a0b4-ab8ec9c62b68 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:33.768857 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dccb4080-d7ca-40ca-a0b4-ab8ec9c62b68 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:33.770624 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dccb4080-d7ca-40ca-a0b4-ab8ec9c62b68 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:33.771364 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dccb4080-d7ca-40ca-a0b4-ab8ec9c62b68 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:33.806349 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-dccb4080-d7ca-40ca-a0b4-ab8ec9c62b68 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] HTTP exception thrown: Instance e19b4dae-fc30-4e15-ad48-d3892ce81801 could not be found. Sep 06 01:12:33.811491 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dccb4080-d7ca-40ca-a0b4-ab8ec9c62b68 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Request method failure captured: Sep 06 01:12:33.811491 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801/os-volume_attachments HTTP/1.1 Sep 06 01:12:33.811491 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept: application/json Sep 06 01:12:33.811491 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept-Encoding: identity Sep 06 01:12:33.811491 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Connection: close Sep 06 01:12:33.811491 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Length: 0 Sep 06 01:12:33.811491 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Type: application/json Sep 06 01:12:33.811491 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Host: 10.222.0.23 Sep 06 01:12:33.811491 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Openstack-System-Scope: None Sep 06 01:12:33.811491 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Sep 06 01:12:33.811491 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjFp5Mn5Xa7JWSTmJefVHWY5l38xpScJfwPmAzkBo2VaLQn4eK8o9TEnX7-EwUT61n5977l6G8yIJMgbYSIKHoNLYZsCp-KbdUsAut8AHXqAoHrGWYwWndRQhN0rRRS3psQ1s8CrEW_kfSxPwE43ttc5FSU6VS4dZfemIIDBmeQNe6ZMo Sep 06 01:12:33.811491 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Id: None Sep 06 01:12:33.811491 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Name: None Sep 06 01:12:33.811491 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Identity-Status: Confirmed Sep 06 01:12:33.811491 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Is-Admin-Project: True Sep 06 01:12:33.811491 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Id: default Sep 06 01:12:33.811491 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Name: Default Sep 06 01:12:33.811491 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Id: 2002558f3d814b1b892ca2d22ff25f05 Sep 06 01:12:33.811491 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Name: tempest-DeleteServersTestJSON-1575745062 Sep 06 01:12:33.811491 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Role: reader,member Sep 06 01:12:33.811491 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Roles: reader,member Sep 06 01:12:33.812719 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2002558f3d814b1b892ca2d22ff25f05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2002558f3d814b1b892ca2d22ff25f05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2002558f3d814b1b892ca2d22ff25f05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2002558f3d814b1b892ca2d22ff25f05"}]}] Sep 06 01:12:33.812719 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant: tempest-DeleteServersTestJSON-1575745062 Sep 06 01:12:33.812719 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Id: 2002558f3d814b1b892ca2d22ff25f05 Sep 06 01:12:33.812719 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Name: tempest-DeleteServersTestJSON-1575745062 Sep 06 01:12:33.812719 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User: tempest-DeleteServersTestJSON-1575745062-project Sep 06 01:12:33.812719 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Id: default Sep 06 01:12:33.812719 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Name: Default Sep 06 01:12:33.812719 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Id: 0354d80eb898418fae8acf8baf4894b1 Sep 06 01:12:33.812719 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Name: tempest-DeleteServersTestJSON-1575745062-project Sep 06 01:12:33.812719 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: method: > Sep 06 01:12:33.812719 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: exception: Instance e19b4dae-fc30-4e15-ad48-d3892ce81801 could not be found. Sep 06 01:12:33.812719 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: action_args: {'server_id': 'e19b4dae-fc30-4e15-ad48-d3892ce81801'} Sep 06 01:12:33.813417 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:12:33.813417 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:12:33.813417 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 01:12:33.813417 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 01:12:33.813417 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 01:12:33.813417 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 01:12:33.813417 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 01:12:33.813417 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 01:12:33.813417 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 01:12:33.813417 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 01:12:33.813417 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e19b4dae-fc30-4e15-ad48-d3892ce81801 could not be found. Sep 06 01:12:33.813417 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:12:33.813417 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:12:33.813417 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:12:33.813417 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:12:33.813417 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:12:33.813417 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:12:33.813417 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:12:33.813417 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:12:33.813417 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:12:33.814424 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:12:33.814424 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 06 01:12:33.814424 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 01:12:33.814424 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 06 01:12:33.814424 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 01:12:33.814424 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 06 01:12:33.814424 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 06 01:12:33.814424 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 01:12:33.814424 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:12:33.814424 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e19b4dae-fc30-4e15-ad48-d3892ce81801 could not be found. Sep 06 01:12:33.814424 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:12:33.814424 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:12:33.814424 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:12:33.814424 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:12:33.814424 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:12:33.814424 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:12:33.814424 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:12:33.814424 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:12:33.814424 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e19b4dae-fc30-4e15-ad48-d3892ce81801 could not be found. Sep 06 01:12:33.814424 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:12:33.816869 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dccb4080-d7ca-40ca-a0b4-ab8ec9c62b68 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Returning 404 to user: Instance e19b4dae-fc30-4e15-ad48-d3892ce81801 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:12:33.818229 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dccb4080-d7ca-40ca-a0b4-ab8ec9c62b68 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] 10.222.0.23 "GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.087669 Sep 06 01:12:33.819009 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 76/154] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 6 01:12:33 2022] GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801/os-volume_attachments => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 01:12:34.337917 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-08d1a988-d31c-41d3-a2e8-992a8e9f58f2 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:34.338527 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-08d1a988-d31c-41d3-a2e8-992a8e9f58f2 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 7589d872-fdde-4504-b16e-1f16598c41d3] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:34.344425 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-08d1a988-d31c-41d3-a2e8-992a8e9f58f2 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:34.344900 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-08d1a988-d31c-41d3-a2e8-992a8e9f58f2 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:34.345345 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-08d1a988-d31c-41d3-a2e8-992a8e9f58f2 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:34.346036 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-08d1a988-d31c-41d3-a2e8-992a8e9f58f2 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:34.346484 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-08d1a988-d31c-41d3-a2e8-992a8e9f58f2 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:34.346903 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-08d1a988-d31c-41d3-a2e8-992a8e9f58f2 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:34.378488 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-81e31bd8-703c-429d-94b9-9bd4a1cb86c7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:34.379153 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-81e31bd8-703c-429d-94b9-9bd4a1cb86c7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:34.386815 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81e31bd8-703c-429d-94b9-9bd4a1cb86c7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:34.387294 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81e31bd8-703c-429d-94b9-9bd4a1cb86c7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:34.387945 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81e31bd8-703c-429d-94b9-9bd4a1cb86c7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:34.388661 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81e31bd8-703c-429d-94b9-9bd4a1cb86c7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:34.389110 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81e31bd8-703c-429d-94b9-9bd4a1cb86c7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:34.389542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81e31bd8-703c-429d-94b9-9bd4a1cb86c7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:34.410110 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-08d1a988-d31c-41d3-a2e8-992a8e9f58f2 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:34.418859 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-08d1a988-d31c-41d3-a2e8-992a8e9f58f2 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/7589d872-fdde-4504-b16e-1f16598c41d3" status: 200 len: 1270 microversion: 2.1 time: 0.085062 Sep 06 01:12:34.419439 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 79/155] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:34 2022] GET /compute/v2.1/servers/7589d872-fdde-4504-b16e-1f16598c41d3 => generated 1270 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:34.530797 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-81e31bd8-703c-429d-94b9-9bd4a1cb86c7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:34.539121 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-81e31bd8-703c-429d-94b9-9bd4a1cb86c7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1522 microversion: 2.1 time: 0.165210 Sep 06 01:12:34.539682 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 77/156] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:34 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:35.207853 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-4a9bb9b7-5bf6-4863-9d41-e6648df6b0bd tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:35.208679 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-4a9bb9b7-5bf6-4863-9d41-e6648df6b0bd tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] [instance: e19b4dae-fc30-4e15-ad48-d3892ce81801] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:35.215882 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4a9bb9b7-5bf6-4863-9d41-e6648df6b0bd tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:35.216756 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4a9bb9b7-5bf6-4863-9d41-e6648df6b0bd tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:35.217733 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4a9bb9b7-5bf6-4863-9d41-e6648df6b0bd tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:35.218788 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4a9bb9b7-5bf6-4863-9d41-e6648df6b0bd tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:35.219237 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4a9bb9b7-5bf6-4863-9d41-e6648df6b0bd tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:35.219961 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4a9bb9b7-5bf6-4863-9d41-e6648df6b0bd tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:35.234626 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.wsgi [None req-4a9bb9b7-5bf6-4863-9d41-e6648df6b0bd tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] HTTP exception thrown: Instance e19b4dae-fc30-4e15-ad48-d3892ce81801 could not be found. Sep 06 01:12:35.236131 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-4a9bb9b7-5bf6-4863-9d41-e6648df6b0bd tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Request method failure captured: Sep 06 01:12:35.236131 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: request: DELETE /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801 HTTP/1.1 Sep 06 01:12:35.236131 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept: application/json Sep 06 01:12:35.236131 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept-Encoding: identity Sep 06 01:12:35.236131 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Connection: close Sep 06 01:12:35.236131 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Length: 0 Sep 06 01:12:35.236131 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Type: application/json Sep 06 01:12:35.236131 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Host: 10.222.0.23 Sep 06 01:12:35.236131 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Openstack-System-Scope: None Sep 06 01:12:35.236131 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: User-Agent: python-urllib3/1.26.12 Sep 06 01:12:35.236131 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Auth-Token: gAAAAABjFp5Mn5Xa7JWSTmJefVHWY5l38xpScJfwPmAzkBo2VaLQn4eK8o9TEnX7-EwUT61n5977l6G8yIJMgbYSIKHoNLYZsCp-KbdUsAut8AHXqAoHrGWYwWndRQhN0rRRS3psQ1s8CrEW_kfSxPwE43ttc5FSU6VS4dZfemIIDBmeQNe6ZMo Sep 06 01:12:35.236131 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Id: None Sep 06 01:12:35.236131 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Name: None Sep 06 01:12:35.236131 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Identity-Status: Confirmed Sep 06 01:12:35.236131 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Is-Admin-Project: True Sep 06 01:12:35.236131 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Id: default Sep 06 01:12:35.236131 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Name: Default Sep 06 01:12:35.236131 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Id: 2002558f3d814b1b892ca2d22ff25f05 Sep 06 01:12:35.236131 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Name: tempest-DeleteServersTestJSON-1575745062 Sep 06 01:12:35.236131 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Role: reader,member Sep 06 01:12:35.236131 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Roles: reader,member Sep 06 01:12:35.237265 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2002558f3d814b1b892ca2d22ff25f05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2002558f3d814b1b892ca2d22ff25f05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2002558f3d814b1b892ca2d22ff25f05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2002558f3d814b1b892ca2d22ff25f05"}]}] Sep 06 01:12:35.237265 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant: tempest-DeleteServersTestJSON-1575745062 Sep 06 01:12:35.237265 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Id: 2002558f3d814b1b892ca2d22ff25f05 Sep 06 01:12:35.237265 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Name: tempest-DeleteServersTestJSON-1575745062 Sep 06 01:12:35.237265 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User: tempest-DeleteServersTestJSON-1575745062-project Sep 06 01:12:35.237265 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Id: default Sep 06 01:12:35.237265 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Name: Default Sep 06 01:12:35.237265 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Id: 0354d80eb898418fae8acf8baf4894b1 Sep 06 01:12:35.237265 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Name: tempest-DeleteServersTestJSON-1575745062-project Sep 06 01:12:35.237265 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: method: > Sep 06 01:12:35.237265 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: exception: Instance e19b4dae-fc30-4e15-ad48-d3892ce81801 could not be found. Sep 06 01:12:35.237265 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: action_args: {'id': 'e19b4dae-fc30-4e15-ad48-d3892ce81801'} Sep 06 01:12:35.237938 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:12:35.237938 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:12:35.237938 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 01:12:35.237938 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 01:12:35.237938 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 01:12:35.237938 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 01:12:35.237938 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 01:12:35.237938 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 01:12:35.237938 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 01:12:35.237938 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 01:12:35.237938 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e19b4dae-fc30-4e15-ad48-d3892ce81801 could not be found. Sep 06 01:12:35.237938 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:12:35.237938 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:12:35.237938 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:12:35.237938 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:12:35.237938 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:12:35.237938 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:12:35.237938 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:12:35.237938 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:12:35.237938 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:12:35.238928 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:12:35.238928 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 01:12:35.238928 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 01:12:35.238928 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 01:12:35.238928 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 01:12:35.238928 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 01:12:35.238928 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 01:12:35.238928 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 01:12:35.238928 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:12:35.238928 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e19b4dae-fc30-4e15-ad48-d3892ce81801 could not be found. Sep 06 01:12:35.238928 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:12:35.238928 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:12:35.238928 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:12:35.238928 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:12:35.238928 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:12:35.238928 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:12:35.238928 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:12:35.238928 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:12:35.238928 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e19b4dae-fc30-4e15-ad48-d3892ce81801 could not be found. Sep 06 01:12:35.238928 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:12:35.240516 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-4a9bb9b7-5bf6-4863-9d41-e6648df6b0bd tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Returning 404 to user: Instance e19b4dae-fc30-4e15-ad48-d3892ce81801 could not be found. {{(pid=120580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:12:35.240516 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-4a9bb9b7-5bf6-4863-9d41-e6648df6b0bd tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801" status: 404 len: 111 microversion: 2.1 time: 0.033500 Sep 06 01:12:35.240516 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 80/157] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 6 01:12:35 2022] DELETE /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 01:12:35.253122 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d03d9af3-13f7-48ca-a14a-a65664c65e25 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:35.254002 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d03d9af3-13f7-48ca-a14a-a65664c65e25 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] [instance: e19b4dae-fc30-4e15-ad48-d3892ce81801] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:35.256219 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:35.262691 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d03d9af3-13f7-48ca-a14a-a65664c65e25 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:35.263180 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d03d9af3-13f7-48ca-a14a-a65664c65e25 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:35.263657 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d03d9af3-13f7-48ca-a14a-a65664c65e25 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:35.264432 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d03d9af3-13f7-48ca-a14a-a65664c65e25 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:35.264941 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d03d9af3-13f7-48ca-a14a-a65664c65e25 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:35.265358 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d03d9af3-13f7-48ca-a14a-a65664c65e25 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:35.282762 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-d03d9af3-13f7-48ca-a14a-a65664c65e25 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] HTTP exception thrown: Instance e19b4dae-fc30-4e15-ad48-d3892ce81801 could not be found. Sep 06 01:12:35.285066 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d03d9af3-13f7-48ca-a14a-a65664c65e25 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Request method failure captured: Sep 06 01:12:35.285066 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801 HTTP/1.1 Sep 06 01:12:35.285066 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept: application/json Sep 06 01:12:35.285066 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept-Encoding: identity Sep 06 01:12:35.285066 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Connection: close Sep 06 01:12:35.285066 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Length: 0 Sep 06 01:12:35.285066 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Type: application/json Sep 06 01:12:35.285066 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Host: 10.222.0.23 Sep 06 01:12:35.285066 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Openstack-System-Scope: None Sep 06 01:12:35.285066 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Sep 06 01:12:35.285066 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjFp5Mn5Xa7JWSTmJefVHWY5l38xpScJfwPmAzkBo2VaLQn4eK8o9TEnX7-EwUT61n5977l6G8yIJMgbYSIKHoNLYZsCp-KbdUsAut8AHXqAoHrGWYwWndRQhN0rRRS3psQ1s8CrEW_kfSxPwE43ttc5FSU6VS4dZfemIIDBmeQNe6ZMo Sep 06 01:12:35.285066 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Id: None Sep 06 01:12:35.285066 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Name: None Sep 06 01:12:35.285066 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Identity-Status: Confirmed Sep 06 01:12:35.285066 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Is-Admin-Project: True Sep 06 01:12:35.285066 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Id: default Sep 06 01:12:35.285066 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Name: Default Sep 06 01:12:35.285066 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Id: 2002558f3d814b1b892ca2d22ff25f05 Sep 06 01:12:35.285066 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Name: tempest-DeleteServersTestJSON-1575745062 Sep 06 01:12:35.285066 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Role: reader,member Sep 06 01:12:35.285066 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Roles: reader,member Sep 06 01:12:35.286429 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2002558f3d814b1b892ca2d22ff25f05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2002558f3d814b1b892ca2d22ff25f05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2002558f3d814b1b892ca2d22ff25f05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2002558f3d814b1b892ca2d22ff25f05"}]}] Sep 06 01:12:35.286429 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant: tempest-DeleteServersTestJSON-1575745062 Sep 06 01:12:35.286429 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Id: 2002558f3d814b1b892ca2d22ff25f05 Sep 06 01:12:35.286429 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Name: tempest-DeleteServersTestJSON-1575745062 Sep 06 01:12:35.286429 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User: tempest-DeleteServersTestJSON-1575745062-project Sep 06 01:12:35.286429 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Id: default Sep 06 01:12:35.286429 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Name: Default Sep 06 01:12:35.286429 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Id: 0354d80eb898418fae8acf8baf4894b1 Sep 06 01:12:35.286429 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Name: tempest-DeleteServersTestJSON-1575745062-project Sep 06 01:12:35.286429 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: method: > Sep 06 01:12:35.286429 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: exception: Instance e19b4dae-fc30-4e15-ad48-d3892ce81801 could not be found. Sep 06 01:12:35.286429 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: action_args: {'id': 'e19b4dae-fc30-4e15-ad48-d3892ce81801'} Sep 06 01:12:35.287267 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:12:35.287267 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:12:35.287267 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 01:12:35.287267 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 01:12:35.287267 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 01:12:35.287267 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 01:12:35.287267 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 01:12:35.287267 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 01:12:35.287267 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 01:12:35.287267 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 01:12:35.287267 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e19b4dae-fc30-4e15-ad48-d3892ce81801 could not be found. Sep 06 01:12:35.287267 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:12:35.287267 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:12:35.287267 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:12:35.287267 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:12:35.287267 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:12:35.287267 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:12:35.287267 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:12:35.287267 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:12:35.287267 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:12:35.289325 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:12:35.289325 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 01:12:35.289325 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 01:12:35.289325 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 01:12:35.289325 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 01:12:35.289325 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 01:12:35.289325 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:12:35.289325 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e19b4dae-fc30-4e15-ad48-d3892ce81801 could not be found. Sep 06 01:12:35.289325 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:12:35.289325 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:12:35.289325 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:12:35.289325 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:12:35.289325 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:12:35.289325 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:12:35.289325 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:12:35.289325 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:12:35.289325 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e19b4dae-fc30-4e15-ad48-d3892ce81801 could not be found. Sep 06 01:12:35.289325 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:12:35.290560 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d03d9af3-13f7-48ca-a14a-a65664c65e25 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] Returning 404 to user: Instance e19b4dae-fc30-4e15-ad48-d3892ce81801 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:12:35.290560 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d03d9af3-13f7-48ca-a14a-a65664c65e25 tempest-DeleteServersTestJSON-1575745062 tempest-DeleteServersTestJSON-1575745062-project] 10.222.0.23 "GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801" status: 404 len: 111 microversion: 2.1 time: 0.043700 Sep 06 01:12:35.291418 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 78/158] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:35 2022] GET /compute/v2.1/servers/e19b4dae-fc30-4e15-ad48-d3892ce81801 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 01:12:35.455976 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-29cafe2c-6c05-47b2-9715-163b4da68b32 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:35.455976 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-29cafe2c-6c05-47b2-9715-163b4da68b32 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 7589d872-fdde-4504-b16e-1f16598c41d3] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:35.463232 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-29cafe2c-6c05-47b2-9715-163b4da68b32 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:35.463729 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-29cafe2c-6c05-47b2-9715-163b4da68b32 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:35.465512 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-29cafe2c-6c05-47b2-9715-163b4da68b32 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:35.469153 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-29cafe2c-6c05-47b2-9715-163b4da68b32 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:35.469631 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-29cafe2c-6c05-47b2-9715-163b4da68b32 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:35.471383 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-29cafe2c-6c05-47b2-9715-163b4da68b32 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:35.564812 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f46d578e-237c-4dd2-875f-b5ccde360cea tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:35.565482 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f46d578e-237c-4dd2-875f-b5ccde360cea tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:35.582563 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f46d578e-237c-4dd2-875f-b5ccde360cea tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:35.584159 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f46d578e-237c-4dd2-875f-b5ccde360cea tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:35.584640 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f46d578e-237c-4dd2-875f-b5ccde360cea tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:35.591441 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f46d578e-237c-4dd2-875f-b5ccde360cea tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:35.592058 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f46d578e-237c-4dd2-875f-b5ccde360cea tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:35.592505 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f46d578e-237c-4dd2-875f-b5ccde360cea tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:35.861043 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-f46d578e-237c-4dd2-875f-b5ccde360cea tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:35.872806 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f46d578e-237c-4dd2-875f-b5ccde360cea tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1522 microversion: 2.1 time: 0.312827 Sep 06 01:12:35.873374 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 79/159] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:35 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:35.901447 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-29cafe2c-6c05-47b2-9715-163b4da68b32 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:35.910689 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-29cafe2c-6c05-47b2-9715-163b4da68b32 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/7589d872-fdde-4504-b16e-1f16598c41d3" status: 200 len: 1318 microversion: 2.1 time: 0.472018 Sep 06 01:12:35.912057 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 81/160] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:35 2022] GET /compute/v2.1/servers/7589d872-fdde-4504-b16e-1f16598c41d3 => generated 1318 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:36.896401 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-79536e75-48d5-402e-8486-5a5851d6fdcb tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:36.897466 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-79536e75-48d5-402e-8486-5a5851d6fdcb tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:36.905785 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-79536e75-48d5-402e-8486-5a5851d6fdcb tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:36.909495 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-79536e75-48d5-402e-8486-5a5851d6fdcb tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:36.910558 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-79536e75-48d5-402e-8486-5a5851d6fdcb tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:36.911993 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-79536e75-48d5-402e-8486-5a5851d6fdcb tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:36.915543 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-79536e75-48d5-402e-8486-5a5851d6fdcb tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:36.916246 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-79536e75-48d5-402e-8486-5a5851d6fdcb tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:36.936237 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-a0791561-cfc6-4007-8a6f-c311eefe38e6 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:36.937415 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-a0791561-cfc6-4007-8a6f-c311eefe38e6 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 7589d872-fdde-4504-b16e-1f16598c41d3] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:36.943419 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:36.955232 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a0791561-cfc6-4007-8a6f-c311eefe38e6 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:36.957464 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a0791561-cfc6-4007-8a6f-c311eefe38e6 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:36.959162 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a0791561-cfc6-4007-8a6f-c311eefe38e6 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:36.963332 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a0791561-cfc6-4007-8a6f-c311eefe38e6 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:36.964101 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a0791561-cfc6-4007-8a6f-c311eefe38e6 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:36.964899 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a0791561-cfc6-4007-8a6f-c311eefe38e6 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:37.332446 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-79536e75-48d5-402e-8486-5a5851d6fdcb tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:37.347194 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-a0791561-cfc6-4007-8a6f-c311eefe38e6 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:37.366050 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-a0791561-cfc6-4007-8a6f-c311eefe38e6 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/7589d872-fdde-4504-b16e-1f16598c41d3" status: 200 len: 1318 microversion: 2.1 time: 0.433877 Sep 06 01:12:37.366868 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-79536e75-48d5-402e-8486-5a5851d6fdcb tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1522 microversion: 2.1 time: 0.470486 Sep 06 01:12:37.379934 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 82/161] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:36 2022] GET /compute/v2.1/servers/7589d872-fdde-4504-b16e-1f16598c41d3 => generated 1318 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:12:37.380552 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 80/162] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:36 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1522 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:37.388951 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-f70cf405-3bfe-456b-82d8-6229456b43b9 req-d03d6343-c6b2-430a-8c83-1e46cd05c229 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7589d872-fdde-4504-b16e-1f16598c41d3", "tag": "946c2665-f95b-40c9-a6fe-05585859c278"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:12:37.405504 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-f70cf405-3bfe-456b-82d8-6229456b43b9 req-d03d6343-c6b2-430a-8c83-1e46cd05c229 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:37.407044 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-f70cf405-3bfe-456b-82d8-6229456b43b9 req-d03d6343-c6b2-430a-8c83-1e46cd05c229 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:37.408185 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-f70cf405-3bfe-456b-82d8-6229456b43b9 req-d03d6343-c6b2-430a-8c83-1e46cd05c229 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:37.424833 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.compute.server_external_events [req-f70cf405-3bfe-456b-82d8-6229456b43b9 req-d03d6343-c6b2-430a-8c83-1e46cd05c229 service nova] Creating event network-changed:946c2665-f95b-40c9-a6fe-05585859c278 for instance 7589d872-fdde-4504-b16e-1f16598c41d3 on hv-cinder-84773 Sep 06 01:12:37.435687 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [req-f70cf405-3bfe-456b-82d8-6229456b43b9 req-d03d6343-c6b2-430a-8c83-1e46cd05c229 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055798 Sep 06 01:12:37.436596 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 83/163] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 01:12:38.399231 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4c66da8d-1f2c-4012-af5b-9249608deda3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:38.399880 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4c66da8d-1f2c-4012-af5b-9249608deda3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:38.408996 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-6995c409-eade-4469-a7c9-83187f4a2c20 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:38.409699 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-6995c409-eade-4469-a7c9-83187f4a2c20 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 7589d872-fdde-4504-b16e-1f16598c41d3] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:38.420224 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6995c409-eade-4469-a7c9-83187f4a2c20 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:38.420937 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6995c409-eade-4469-a7c9-83187f4a2c20 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:38.421569 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c66da8d-1f2c-4012-af5b-9249608deda3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:38.422175 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6995c409-eade-4469-a7c9-83187f4a2c20 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:38.422824 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c66da8d-1f2c-4012-af5b-9249608deda3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:38.423988 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6995c409-eade-4469-a7c9-83187f4a2c20 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:38.424582 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c66da8d-1f2c-4012-af5b-9249608deda3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:38.425192 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6995c409-eade-4469-a7c9-83187f4a2c20 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:38.426101 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c66da8d-1f2c-4012-af5b-9249608deda3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:38.426703 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6995c409-eade-4469-a7c9-83187f4a2c20 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:38.427307 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c66da8d-1f2c-4012-af5b-9249608deda3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:38.428231 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c66da8d-1f2c-4012-af5b-9249608deda3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:38.783565 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-6995c409-eade-4469-a7c9-83187f4a2c20 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:38.794074 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-6995c409-eade-4469-a7c9-83187f4a2c20 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/7589d872-fdde-4504-b16e-1f16598c41d3" status: 200 len: 1318 microversion: 2.1 time: 0.388950 Sep 06 01:12:38.807787 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 84/164] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:38 2022] GET /compute/v2.1/servers/7589d872-fdde-4504-b16e-1f16598c41d3 => generated 1318 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:12:38.909558 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-4c66da8d-1f2c-4012-af5b-9249608deda3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:38.922759 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4c66da8d-1f2c-4012-af5b-9249608deda3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1522 microversion: 2.1 time: 0.527752 Sep 06 01:12:38.940933 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 81/165] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:38 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1522 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:12:39.821438 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-281eb6a1-e6e2-4740-8da7-5cab0de96b9b tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:39.822166 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-281eb6a1-e6e2-4740-8da7-5cab0de96b9b tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 7589d872-fdde-4504-b16e-1f16598c41d3] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:39.829648 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-281eb6a1-e6e2-4740-8da7-5cab0de96b9b tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:39.830387 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-281eb6a1-e6e2-4740-8da7-5cab0de96b9b tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:39.831059 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-281eb6a1-e6e2-4740-8da7-5cab0de96b9b tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:39.831851 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-281eb6a1-e6e2-4740-8da7-5cab0de96b9b tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:39.832534 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-281eb6a1-e6e2-4740-8da7-5cab0de96b9b tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:39.833164 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-281eb6a1-e6e2-4740-8da7-5cab0de96b9b tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:39.953046 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1688836d-2290-4f2e-9b0b-ef74bb5e23fe tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:39.954277 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1688836d-2290-4f2e-9b0b-ef74bb5e23fe tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:39.964662 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1688836d-2290-4f2e-9b0b-ef74bb5e23fe tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:39.965974 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1688836d-2290-4f2e-9b0b-ef74bb5e23fe tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:39.967155 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1688836d-2290-4f2e-9b0b-ef74bb5e23fe tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:39.970057 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1688836d-2290-4f2e-9b0b-ef74bb5e23fe tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:39.970707 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1688836d-2290-4f2e-9b0b-ef74bb5e23fe tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:39.973870 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1688836d-2290-4f2e-9b0b-ef74bb5e23fe tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:40.136470 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-281eb6a1-e6e2-4740-8da7-5cab0de96b9b tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:40.146783 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-281eb6a1-e6e2-4740-8da7-5cab0de96b9b tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/7589d872-fdde-4504-b16e-1f16598c41d3" status: 200 len: 1318 microversion: 2.1 time: 0.332179 Sep 06 01:12:40.149830 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 85/166] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:39 2022] GET /compute/v2.1/servers/7589d872-fdde-4504-b16e-1f16598c41d3 => generated 1318 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:40.283656 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-1688836d-2290-4f2e-9b0b-ef74bb5e23fe tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:40.296575 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1688836d-2290-4f2e-9b0b-ef74bb5e23fe tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1522 microversion: 2.1 time: 0.350053 Sep 06 01:12:40.297151 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 82/167] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:39 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:41.175840 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-cca11a52-9982-4d55-9a5a-a0a93224f8cd tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:41.177745 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-cca11a52-9982-4d55-9a5a-a0a93224f8cd tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 7589d872-fdde-4504-b16e-1f16598c41d3] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:41.195859 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cca11a52-9982-4d55-9a5a-a0a93224f8cd tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:41.198250 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cca11a52-9982-4d55-9a5a-a0a93224f8cd tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:41.199480 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cca11a52-9982-4d55-9a5a-a0a93224f8cd tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:41.200683 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cca11a52-9982-4d55-9a5a-a0a93224f8cd tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:41.204759 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cca11a52-9982-4d55-9a5a-a0a93224f8cd tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:41.206719 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cca11a52-9982-4d55-9a5a-a0a93224f8cd tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:41.320537 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a8b77731-5745-45a1-a867-d0d77cd3abdf tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:41.321144 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a8b77731-5745-45a1-a867-d0d77cd3abdf tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:41.330808 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8b77731-5745-45a1-a867-d0d77cd3abdf tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:41.332041 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8b77731-5745-45a1-a867-d0d77cd3abdf tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:41.332471 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8b77731-5745-45a1-a867-d0d77cd3abdf tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:41.334416 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8b77731-5745-45a1-a867-d0d77cd3abdf tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:41.341097 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8b77731-5745-45a1-a867-d0d77cd3abdf tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:41.341537 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8b77731-5745-45a1-a867-d0d77cd3abdf tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:41.654297 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-cca11a52-9982-4d55-9a5a-a0a93224f8cd tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:41.666326 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-cca11a52-9982-4d55-9a5a-a0a93224f8cd tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/7589d872-fdde-4504-b16e-1f16598c41d3" status: 200 len: 1318 microversion: 2.1 time: 0.493047 Sep 06 01:12:41.667435 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 86/168] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:41 2022] GET /compute/v2.1/servers/7589d872-fdde-4504-b16e-1f16598c41d3 => generated 1318 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:41.708325 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-a8b77731-5745-45a1-a867-d0d77cd3abdf tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:41.724226 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a8b77731-5745-45a1-a867-d0d77cd3abdf tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1522 microversion: 2.1 time: 0.407053 Sep 06 01:12:41.724826 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 83/169] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:41 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1522 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:12:42.696472 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-aacc37c0-7f34-48cf-a47b-c876ae92b10c tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:42.697532 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-aacc37c0-7f34-48cf-a47b-c876ae92b10c tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 7589d872-fdde-4504-b16e-1f16598c41d3] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:42.706984 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-aacc37c0-7f34-48cf-a47b-c876ae92b10c tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:42.707707 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-aacc37c0-7f34-48cf-a47b-c876ae92b10c tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:42.708268 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-aacc37c0-7f34-48cf-a47b-c876ae92b10c tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:42.709355 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-aacc37c0-7f34-48cf-a47b-c876ae92b10c tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:42.710251 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-aacc37c0-7f34-48cf-a47b-c876ae92b10c tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:42.712052 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-aacc37c0-7f34-48cf-a47b-c876ae92b10c tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:42.752551 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1dbc8e9b-fd7e-441d-a5a1-8c5f42480282 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:42.753938 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1dbc8e9b-fd7e-441d-a5a1-8c5f42480282 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:42.772404 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1dbc8e9b-fd7e-441d-a5a1-8c5f42480282 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:42.773127 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1dbc8e9b-fd7e-441d-a5a1-8c5f42480282 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:42.774053 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1dbc8e9b-fd7e-441d-a5a1-8c5f42480282 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:42.775167 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1dbc8e9b-fd7e-441d-a5a1-8c5f42480282 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:42.776090 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1dbc8e9b-fd7e-441d-a5a1-8c5f42480282 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:42.776737 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1dbc8e9b-fd7e-441d-a5a1-8c5f42480282 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:43.103536 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-aacc37c0-7f34-48cf-a47b-c876ae92b10c tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:43.117517 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-aacc37c0-7f34-48cf-a47b-c876ae92b10c tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/7589d872-fdde-4504-b16e-1f16598c41d3" status: 200 len: 1318 microversion: 2.1 time: 0.428572 Sep 06 01:12:43.118251 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 87/170] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:42 2022] GET /compute/v2.1/servers/7589d872-fdde-4504-b16e-1f16598c41d3 => generated 1318 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:43.174583 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-1dbc8e9b-fd7e-441d-a5a1-8c5f42480282 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:43.191079 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1dbc8e9b-fd7e-441d-a5a1-8c5f42480282 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1522 microversion: 2.1 time: 0.438331 Sep 06 01:12:43.192433 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 84/171] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:42 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1522 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:44.149078 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-62e17e98-63a7-4c6c-b8b9-83f7abb855a3 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:44.154909 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-62e17e98-63a7-4c6c-b8b9-83f7abb855a3 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 7589d872-fdde-4504-b16e-1f16598c41d3] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:44.168935 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell0:SELECT=2 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:44.170154 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell0:SELECT=8 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:44.174250 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-62e17e98-63a7-4c6c-b8b9-83f7abb855a3 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:44.175513 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-62e17e98-63a7-4c6c-b8b9-83f7abb855a3 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:44.176132 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-62e17e98-63a7-4c6c-b8b9-83f7abb855a3 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:44.177029 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-62e17e98-63a7-4c6c-b8b9-83f7abb855a3 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:44.179377 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-62e17e98-63a7-4c6c-b8b9-83f7abb855a3 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:44.180370 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-62e17e98-63a7-4c6c-b8b9-83f7abb855a3 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:44.216197 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d586d9ea-592c-45cc-8f15-098e136058da tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:44.217538 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d586d9ea-592c-45cc-8f15-098e136058da tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:44.241216 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d586d9ea-592c-45cc-8f15-098e136058da tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:44.242392 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d586d9ea-592c-45cc-8f15-098e136058da tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:44.243685 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d586d9ea-592c-45cc-8f15-098e136058da tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:44.250024 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d586d9ea-592c-45cc-8f15-098e136058da tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:44.253767 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d586d9ea-592c-45cc-8f15-098e136058da tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:44.254441 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d586d9ea-592c-45cc-8f15-098e136058da tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:44.515161 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-62e17e98-63a7-4c6c-b8b9-83f7abb855a3 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:44.520302 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-d586d9ea-592c-45cc-8f15-098e136058da tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:44.524554 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-62e17e98-63a7-4c6c-b8b9-83f7abb855a3 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/7589d872-fdde-4504-b16e-1f16598c41d3" status: 200 len: 1318 microversion: 2.1 time: 0.383223 Sep 06 01:12:44.529018 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d586d9ea-592c-45cc-8f15-098e136058da tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1522 microversion: 2.1 time: 0.317890 Sep 06 01:12:44.529804 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 88/172] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:44 2022] GET /compute/v2.1/servers/7589d872-fdde-4504-b16e-1f16598c41d3 => generated 1318 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:12:44.531150 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 85/173] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:44 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1522 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:12:45.431705 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-84f797f1-4c65-450e-b7f2-272878e41ddb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-746551966", "imageRef": "768973cc-7b5f-4eed-b493-e40eb0de9f88", "flavorRef": "452", "networks": [{"uuid": "61626a63-787f-48a9-bed6-847e96c21b9d"}]}} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:12:45.496327 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.network.neutron [None req-84f797f1-4c65-450e-b7f2-272878e41ddb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] validate_networks() for [('61626a63-787f-48a9-bed6-847e96c21b9d', None, None, None, None, None)] {{(pid=120580) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 01:12:45.547921 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a90f5ea6-90f6-492f-8894-1deead5a9cfe tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:45.549100 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a90f5ea6-90f6-492f-8894-1deead5a9cfe tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 7589d872-fdde-4504-b16e-1f16598c41d3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:45.561747 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a90f5ea6-90f6-492f-8894-1deead5a9cfe tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:45.562851 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a90f5ea6-90f6-492f-8894-1deead5a9cfe tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:45.563564 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a90f5ea6-90f6-492f-8894-1deead5a9cfe tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:45.564617 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a90f5ea6-90f6-492f-8894-1deead5a9cfe tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:45.565289 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a90f5ea6-90f6-492f-8894-1deead5a9cfe tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:45.565968 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a90f5ea6-90f6-492f-8894-1deead5a9cfe tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:45.866833 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-a90f5ea6-90f6-492f-8894-1deead5a9cfe tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:45.876072 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a90f5ea6-90f6-492f-8894-1deead5a9cfe tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/7589d872-fdde-4504-b16e-1f16598c41d3" status: 200 len: 1318 microversion: 2.1 time: 0.333199 Sep 06 01:12:45.882550 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 86/174] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:45 2022] GET /compute/v2.1/servers/7589d872-fdde-4504-b16e-1f16598c41d3 => generated 1318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:12:45.904842 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2d236625-6540-4166-b7cb-923d23fd5109 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:45.906947 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2d236625-6540-4166-b7cb-923d23fd5109 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:45.915423 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2d236625-6540-4166-b7cb-923d23fd5109 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:45.916054 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2d236625-6540-4166-b7cb-923d23fd5109 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:45.916734 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2d236625-6540-4166-b7cb-923d23fd5109 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:45.917717 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2d236625-6540-4166-b7cb-923d23fd5109 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:45.918634 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2d236625-6540-4166-b7cb-923d23fd5109 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:45.919271 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2d236625-6540-4166-b7cb-923d23fd5109 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:46.203408 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-84f797f1-4c65-450e-b7f2-272878e41ddb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Flavor limits 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 01:12:46.204517 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-84f797f1-4c65-450e-b7f2-272878e41ddb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Image limits 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 01:12:46.205279 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-84f797f1-4c65-450e-b7f2-272878e41ddb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Flavor pref 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 01:12:46.205836 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-84f797f1-4c65-450e-b7f2-272878e41ddb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Image pref 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 01:12:46.206376 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-84f797f1-4c65-450e-b7f2-272878e41ddb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 01:12:46.221451 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-84f797f1-4c65-450e-b7f2-272878e41ddb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:46.223472 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-84f797f1-4c65-450e-b7f2-272878e41ddb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:46.225018 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-84f797f1-4c65-450e-b7f2-272878e41ddb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:46.227833 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-84f797f1-4c65-450e-b7f2-272878e41ddb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:46.228639 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-84f797f1-4c65-450e-b7f2-272878e41ddb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:46.230937 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-84f797f1-4c65-450e-b7f2-272878e41ddb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:46.247780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-2d236625-6540-4166-b7cb-923d23fd5109 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:46.261185 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2d236625-6540-4166-b7cb-923d23fd5109 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1522 microversion: 2.1 time: 0.377482 Sep 06 01:12:46.265387 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 87/175] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:45 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1522 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:46.271529 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.quota [None req-84f797f1-4c65-450e-b7f2-272878e41ddb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Getting quotas for project 9ead4033c51d4658a5406c045da1c26e. Resources: {'instances', 'ram', 'cores'} {{(pid=120580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 01:12:46.276153 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.quota [None req-84f797f1-4c65-450e-b7f2-272878e41ddb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Getting quotas for user 453fa4c58743419bb29e5f01d9f78041 and project 9ead4033c51d4658a5406c045da1c26e. Resources: {'instances', 'ram', 'cores'} {{(pid=120580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 01:12:46.283734 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-e82630ca-317e-4cca-85d8-a19d6d77a052 req-10048c34-60f3-4a3a-92cd-bb0ee45f1434 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7589d872-fdde-4504-b16e-1f16598c41d3", "name": "network-vif-plugged", "status": "completed", "tag": "946c2665-f95b-40c9-a6fe-05585859c278"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:12:46.297519 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-84f797f1-4c65-450e-b7f2-272878e41ddb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Going to run 1 instances... {{(pid=120580) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 01:12:46.300776 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-84f797f1-4c65-450e-b7f2-272878e41ddb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: 0abe5353-a09f-4fe0-a899-a4f72171e6da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='768973cc-7b5f-4eed-b493-e40eb0de9f88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 01:12:46.311217 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e82630ca-317e-4cca-85d8-a19d6d77a052 req-10048c34-60f3-4a3a-92cd-bb0ee45f1434 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:46.311703 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e82630ca-317e-4cca-85d8-a19d6d77a052 req-10048c34-60f3-4a3a-92cd-bb0ee45f1434 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:46.312159 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e82630ca-317e-4cca-85d8-a19d6d77a052 req-10048c34-60f3-4a3a-92cd-bb0ee45f1434 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:46.333054 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:46.352553 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-e82630ca-317e-4cca-85d8-a19d6d77a052 req-10048c34-60f3-4a3a-92cd-bb0ee45f1434 service nova] Creating event network-vif-plugged:946c2665-f95b-40c9-a6fe-05585859c278 for instance 7589d872-fdde-4504-b16e-1f16598c41d3 on hv-cinder-84773 Sep 06 01:12:46.360596 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-e82630ca-317e-4cca-85d8-a19d6d77a052 req-10048c34-60f3-4a3a-92cd-bb0ee45f1434 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092304 Sep 06 01:12:46.361190 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 88/176] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:12:46.382179 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-84f797f1-4c65-450e-b7f2-272878e41ddb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.953712 Sep 06 01:12:46.383975 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 89/177] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Sep 6 01:12:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 01:12:46.408442 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-108c6f9e-73cd-4e83-b3c2-dcd85a305279 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:46.409287 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-108c6f9e-73cd-4e83-b3c2-dcd85a305279 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: 0abe5353-a09f-4fe0-a899-a4f72171e6da] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:46.520811 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-108c6f9e-73cd-4e83-b3c2-dcd85a305279 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:46.541558 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-108c6f9e-73cd-4e83-b3c2-dcd85a305279 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/0abe5353-a09f-4fe0-a899-a4f72171e6da" status: 200 len: 1213 microversion: 2.1 time: 0.151006 Sep 06 01:12:46.546010 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 89/178] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:46 2022] GET /compute/v2.1/servers/0abe5353-a09f-4fe0-a899-a4f72171e6da => generated 1213 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:46.901330 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-c7ff70bb-00ae-4885-adae-169243731742 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:46.902163 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-c7ff70bb-00ae-4885-adae-169243731742 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 7589d872-fdde-4504-b16e-1f16598c41d3] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:46.918923 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c7ff70bb-00ae-4885-adae-169243731742 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:46.919909 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c7ff70bb-00ae-4885-adae-169243731742 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:46.921695 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c7ff70bb-00ae-4885-adae-169243731742 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:46.922595 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c7ff70bb-00ae-4885-adae-169243731742 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:46.925077 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c7ff70bb-00ae-4885-adae-169243731742 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:46.925685 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c7ff70bb-00ae-4885-adae-169243731742 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:47.187406 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-c7ff70bb-00ae-4885-adae-169243731742 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:47.202339 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-c7ff70bb-00ae-4885-adae-169243731742 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/7589d872-fdde-4504-b16e-1f16598c41d3" status: 200 len: 1318 microversion: 2.1 time: 0.305781 Sep 06 01:12:47.202914 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 90/179] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:46 2022] GET /compute/v2.1/servers/7589d872-fdde-4504-b16e-1f16598c41d3 => generated 1318 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:47.286190 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b3b02ac5-3f39-48d4-ab19-80230f13d41e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:47.296245 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b3b02ac5-3f39-48d4-ab19-80230f13d41e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:47.316486 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b3b02ac5-3f39-48d4-ab19-80230f13d41e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:47.330850 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b3b02ac5-3f39-48d4-ab19-80230f13d41e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:47.331359 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b3b02ac5-3f39-48d4-ab19-80230f13d41e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:47.332246 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b3b02ac5-3f39-48d4-ab19-80230f13d41e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:47.332784 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b3b02ac5-3f39-48d4-ab19-80230f13d41e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:47.335924 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b3b02ac5-3f39-48d4-ab19-80230f13d41e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:47.568084 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-03e27c94-5211-4c87-a1a5-01806c41fc2d tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:47.569968 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-03e27c94-5211-4c87-a1a5-01806c41fc2d tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: 0abe5353-a09f-4fe0-a899-a4f72171e6da] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:47.577941 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-03e27c94-5211-4c87-a1a5-01806c41fc2d tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:47.579064 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-03e27c94-5211-4c87-a1a5-01806c41fc2d tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:47.579731 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-03e27c94-5211-4c87-a1a5-01806c41fc2d tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:47.580948 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-03e27c94-5211-4c87-a1a5-01806c41fc2d tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:47.581660 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-03e27c94-5211-4c87-a1a5-01806c41fc2d tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:47.582313 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-03e27c94-5211-4c87-a1a5-01806c41fc2d tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:47.736556 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-03e27c94-5211-4c87-a1a5-01806c41fc2d tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:47.748940 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-03e27c94-5211-4c87-a1a5-01806c41fc2d tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/0abe5353-a09f-4fe0-a899-a4f72171e6da" status: 200 len: 1265 microversion: 2.1 time: 0.185072 Sep 06 01:12:47.749509 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 91/180] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:47 2022] GET /compute/v2.1/servers/0abe5353-a09f-4fe0-a899-a4f72171e6da => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:12:47.910964 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-b3b02ac5-3f39-48d4-ab19-80230f13d41e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:47.927976 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b3b02ac5-3f39-48d4-ab19-80230f13d41e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1522 microversion: 2.1 time: 0.646111 Sep 06 01:12:47.929593 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 90/181] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:47 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1522 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:48.227669 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-a8754f8b-7078-42a0-ae4a-05178f916f23 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:48.228891 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-a8754f8b-7078-42a0-ae4a-05178f916f23 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 7589d872-fdde-4504-b16e-1f16598c41d3] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:48.250237 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a8754f8b-7078-42a0-ae4a-05178f916f23 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:48.251354 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a8754f8b-7078-42a0-ae4a-05178f916f23 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:48.253509 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a8754f8b-7078-42a0-ae4a-05178f916f23 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:48.254398 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a8754f8b-7078-42a0-ae4a-05178f916f23 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:48.256733 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a8754f8b-7078-42a0-ae4a-05178f916f23 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:48.257204 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a8754f8b-7078-42a0-ae4a-05178f916f23 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:48.611728 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-a8754f8b-7078-42a0-ae4a-05178f916f23 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:48.628443 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-a8754f8b-7078-42a0-ae4a-05178f916f23 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/7589d872-fdde-4504-b16e-1f16598c41d3" status: 200 len: 1318 microversion: 2.1 time: 0.405202 Sep 06 01:12:48.636894 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 92/182] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:48 2022] GET /compute/v2.1/servers/7589d872-fdde-4504-b16e-1f16598c41d3 => generated 1318 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:48.781610 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-13698995-4a16-4ce1-adce-e57b0e8189ad tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:48.784059 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-13698995-4a16-4ce1-adce-e57b0e8189ad tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: 0abe5353-a09f-4fe0-a899-a4f72171e6da] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:48.791464 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-13698995-4a16-4ce1-adce-e57b0e8189ad tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:48.792062 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-13698995-4a16-4ce1-adce-e57b0e8189ad tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:48.792751 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-13698995-4a16-4ce1-adce-e57b0e8189ad tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:48.793989 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-13698995-4a16-4ce1-adce-e57b0e8189ad tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:48.794671 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-13698995-4a16-4ce1-adce-e57b0e8189ad tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:48.795440 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-13698995-4a16-4ce1-adce-e57b0e8189ad tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:48.901378 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-13698995-4a16-4ce1-adce-e57b0e8189ad tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:48.923318 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-13698995-4a16-4ce1-adce-e57b0e8189ad tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/0abe5353-a09f-4fe0-a899-a4f72171e6da" status: 200 len: 1265 microversion: 2.1 time: 0.151714 Sep 06 01:12:48.925008 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 91/183] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:48 2022] GET /compute/v2.1/servers/0abe5353-a09f-4fe0-a899-a4f72171e6da => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:48.952835 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-90daf1cd-8510-4713-b099-509421dc60bd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:48.953717 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-90daf1cd-8510-4713-b099-509421dc60bd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:48.962726 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-90daf1cd-8510-4713-b099-509421dc60bd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:48.963485 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-90daf1cd-8510-4713-b099-509421dc60bd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:48.964223 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-90daf1cd-8510-4713-b099-509421dc60bd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:48.965174 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-90daf1cd-8510-4713-b099-509421dc60bd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:48.965835 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-90daf1cd-8510-4713-b099-509421dc60bd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:48.966488 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-90daf1cd-8510-4713-b099-509421dc60bd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:49.213244 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-90daf1cd-8510-4713-b099-509421dc60bd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:49.221665 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-90daf1cd-8510-4713-b099-509421dc60bd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1522 microversion: 2.1 time: 0.272739 Sep 06 01:12:49.222474 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 93/184] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:48 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:49.653744 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d919028b-453b-4b4f-bfde-5d3c343a2464 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:49.654675 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d919028b-453b-4b4f-bfde-5d3c343a2464 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 7589d872-fdde-4504-b16e-1f16598c41d3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:49.664955 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d919028b-453b-4b4f-bfde-5d3c343a2464 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:49.665677 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d919028b-453b-4b4f-bfde-5d3c343a2464 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:49.666935 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d919028b-453b-4b4f-bfde-5d3c343a2464 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:49.674904 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d919028b-453b-4b4f-bfde-5d3c343a2464 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:49.682812 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d919028b-453b-4b4f-bfde-5d3c343a2464 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:49.683275 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d919028b-453b-4b4f-bfde-5d3c343a2464 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:49.948019 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-5e310ccb-6b55-4adb-8f8c-f79293bdee19 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:49.949231 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-5e310ccb-6b55-4adb-8f8c-f79293bdee19 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: 0abe5353-a09f-4fe0-a899-a4f72171e6da] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:49.960012 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5e310ccb-6b55-4adb-8f8c-f79293bdee19 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:49.960696 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5e310ccb-6b55-4adb-8f8c-f79293bdee19 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:49.965000 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5e310ccb-6b55-4adb-8f8c-f79293bdee19 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:49.967358 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5e310ccb-6b55-4adb-8f8c-f79293bdee19 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:49.968152 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5e310ccb-6b55-4adb-8f8c-f79293bdee19 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:49.968767 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5e310ccb-6b55-4adb-8f8c-f79293bdee19 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:49.995506 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-d919028b-453b-4b4f-bfde-5d3c343a2464 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:50.012008 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell1:SELECT=100 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:50.014135 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d919028b-453b-4b4f-bfde-5d3c343a2464 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/7589d872-fdde-4504-b16e-1f16598c41d3" status: 200 len: 1507 microversion: 2.1 time: 0.365154 Sep 06 01:12:50.016808 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 92/185] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:49 2022] GET /compute/v2.1/servers/7589d872-fdde-4504-b16e-1f16598c41d3 => generated 1507 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:50.102762 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-5e310ccb-6b55-4adb-8f8c-f79293bdee19 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:50.113861 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-5e310ccb-6b55-4adb-8f8c-f79293bdee19 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/0abe5353-a09f-4fe0-a899-a4f72171e6da" status: 200 len: 1271 microversion: 2.1 time: 0.171002 Sep 06 01:12:50.132020 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 94/186] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:49 2022] GET /compute/v2.1/servers/0abe5353-a09f-4fe0-a899-a4f72171e6da => generated 1271 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:50.245480 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-38a33497-9a3d-45ee-8ceb-c083504d306b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:50.247400 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-38a33497-9a3d-45ee-8ceb-c083504d306b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:50.275383 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-38a33497-9a3d-45ee-8ceb-c083504d306b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:50.276169 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-38a33497-9a3d-45ee-8ceb-c083504d306b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:50.276941 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-38a33497-9a3d-45ee-8ceb-c083504d306b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:50.279235 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-38a33497-9a3d-45ee-8ceb-c083504d306b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:50.281315 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-38a33497-9a3d-45ee-8ceb-c083504d306b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:50.281963 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-38a33497-9a3d-45ee-8ceb-c083504d306b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:50.502996 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-38a33497-9a3d-45ee-8ceb-c083504d306b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:50.513605 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-38a33497-9a3d-45ee-8ceb-c083504d306b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1522 microversion: 2.1 time: 0.271987 Sep 06 01:12:50.514225 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 95/187] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:50 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:50.723830 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b0771cb0-2497-434e-b013-2268469bf2a7 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Action: 'create', calling method: .version_select at 0x7fb06e4e6700>, body: {"keypair": {"name": "tempest-keypair-80550387", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMwJQ88qWYlly3u0jrX+mynJ6/3P3440MdD/3QpEKFy/osjKXcO8os7Ih5slaFNwiamr1YsT09w2oaFkM2fJILS0+pgny+Ox0hhwHOaRT+R8GMhmjgi9o4BkSagrcPELzg=="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:12:50.763027 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.quota [None req-b0771cb0-2497-434e-b013-2268469bf2a7 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Getting quotas for project 80cfec738cab491ba413e062b5a00813. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 01:12:50.769275 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.quota [None req-b0771cb0-2497-434e-b013-2268469bf2a7 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Getting quotas for user e17a4e664b2c4ac9a9fea65287faad95 and project 80cfec738cab491ba413e062b5a00813. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 01:12:50.816127 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b0771cb0-2497-434e-b013-2268469bf2a7 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.572186 Sep 06 01:12:50.817468 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 93/188] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Sep 6 01:12:50 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:12:51.147964 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-018c0a24-73ca-4a38-83b7-ffde5335c81a tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:51.148824 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-018c0a24-73ca-4a38-83b7-ffde5335c81a tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: 0abe5353-a09f-4fe0-a899-a4f72171e6da] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:51.163136 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-018c0a24-73ca-4a38-83b7-ffde5335c81a tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:51.164583 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-018c0a24-73ca-4a38-83b7-ffde5335c81a tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:51.166428 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-018c0a24-73ca-4a38-83b7-ffde5335c81a tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:51.167346 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-018c0a24-73ca-4a38-83b7-ffde5335c81a tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:51.168786 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-018c0a24-73ca-4a38-83b7-ffde5335c81a tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:51.169317 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-018c0a24-73ca-4a38-83b7-ffde5335c81a tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:51.406112 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-018c0a24-73ca-4a38-83b7-ffde5335c81a tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:51.419168 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-018c0a24-73ca-4a38-83b7-ffde5335c81a tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/0abe5353-a09f-4fe0-a899-a4f72171e6da" status: 200 len: 1313 microversion: 2.1 time: 0.277797 Sep 06 01:12:51.420086 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 96/189] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:51 2022] GET /compute/v2.1/servers/0abe5353-a09f-4fe0-a899-a4f72171e6da => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:12:51.536922 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fa4c3874-bd06-4cdb-8375-76c3058ce36d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:51.539133 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fa4c3874-bd06-4cdb-8375-76c3058ce36d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:51.553180 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa4c3874-bd06-4cdb-8375-76c3058ce36d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:51.553924 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa4c3874-bd06-4cdb-8375-76c3058ce36d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:51.554365 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa4c3874-bd06-4cdb-8375-76c3058ce36d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:51.555066 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa4c3874-bd06-4cdb-8375-76c3058ce36d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:51.555509 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa4c3874-bd06-4cdb-8375-76c3058ce36d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:51.556138 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa4c3874-bd06-4cdb-8375-76c3058ce36d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:51.880551 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-8c895a07-c831-47d1-a508-1ccf7617c383 req-78aeb996-5ba9-4159-8aa5-f6e6fa0afdd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0abe5353-a09f-4fe0-a899-a4f72171e6da", "tag": "5c2b7e5a-f039-44dc-a82d-dc5714f30e9d"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:12:51.896362 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-8c895a07-c831-47d1-a508-1ccf7617c383 req-78aeb996-5ba9-4159-8aa5-f6e6fa0afdd6 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:51.900363 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-8c895a07-c831-47d1-a508-1ccf7617c383 req-78aeb996-5ba9-4159-8aa5-f6e6fa0afdd6 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:51.900805 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-8c895a07-c831-47d1-a508-1ccf7617c383 req-78aeb996-5ba9-4159-8aa5-f6e6fa0afdd6 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:51.926662 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.compute.server_external_events [req-8c895a07-c831-47d1-a508-1ccf7617c383 req-78aeb996-5ba9-4159-8aa5-f6e6fa0afdd6 service nova] Creating event network-changed:5c2b7e5a-f039-44dc-a82d-dc5714f30e9d for instance 0abe5353-a09f-4fe0-a899-a4f72171e6da on hv-cinder-84773 Sep 06 01:12:51.946199 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [req-8c895a07-c831-47d1-a508-1ccf7617c383 req-78aeb996-5ba9-4159-8aa5-f6e6fa0afdd6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070253 Sep 06 01:12:51.946723 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 97/190] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 01:12:52.011377 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-fa4c3874-bd06-4cdb-8375-76c3058ce36d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:52.034912 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fa4c3874-bd06-4cdb-8375-76c3058ce36d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1522 microversion: 2.1 time: 0.501849 Sep 06 01:12:52.049775 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 94/191] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:51 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1522 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:12:52.443173 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-c70f4e78-6bed-48ad-8722-7cb6da1893fb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:52.444532 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-c70f4e78-6bed-48ad-8722-7cb6da1893fb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: 0abe5353-a09f-4fe0-a899-a4f72171e6da] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:52.451153 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c70f4e78-6bed-48ad-8722-7cb6da1893fb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:52.451899 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c70f4e78-6bed-48ad-8722-7cb6da1893fb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:52.452530 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c70f4e78-6bed-48ad-8722-7cb6da1893fb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:52.453602 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c70f4e78-6bed-48ad-8722-7cb6da1893fb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:52.454296 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c70f4e78-6bed-48ad-8722-7cb6da1893fb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:52.455154 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c70f4e78-6bed-48ad-8722-7cb6da1893fb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:52.781208 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-c70f4e78-6bed-48ad-8722-7cb6da1893fb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:52.796730 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-c70f4e78-6bed-48ad-8722-7cb6da1893fb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/0abe5353-a09f-4fe0-a899-a4f72171e6da" status: 200 len: 1313 microversion: 2.1 time: 0.353137 Sep 06 01:12:52.798099 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 98/192] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:52 2022] GET /compute/v2.1/servers/0abe5353-a09f-4fe0-a899-a4f72171e6da => generated 1313 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:53.021616 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0401e7ab-7e97-4bcb-9268-15cf732798bd tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1159753774", "imageRef": "768973cc-7b5f-4eed-b493-e40eb0de9f88", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dcf25d1c-5a22-43e5-ace0-2f3939ca0a91"}], "security_groups": [{"name": "tempest-securitygroup--1462376940"}], "key_name": "tempest-keypair-80550387", "user_data": "}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:12:53.061548 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-a0839fe7-496a-48ff-80af-e76ce50d6411 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:53.062291 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-a0839fe7-496a-48ff-80af-e76ce50d6411 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:53.087367 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a0839fe7-496a-48ff-80af-e76ce50d6411 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:53.087902 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a0839fe7-496a-48ff-80af-e76ce50d6411 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:53.088613 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a0839fe7-496a-48ff-80af-e76ce50d6411 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:53.089533 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a0839fe7-496a-48ff-80af-e76ce50d6411 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:53.090013 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a0839fe7-496a-48ff-80af-e76ce50d6411 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:53.090505 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a0839fe7-496a-48ff-80af-e76ce50d6411 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:53.227591 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-a0839fe7-496a-48ff-80af-e76ce50d6411 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:53.236472 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-a0839fe7-496a-48ff-80af-e76ce50d6411 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1522 microversion: 2.1 time: 0.178830 Sep 06 01:12:53.237560 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 99/193] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:53 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:12:53.828705 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-9e96923b-0ca6-4aae-b6c6-a90810340b85 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:53.829349 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-9e96923b-0ca6-4aae-b6c6-a90810340b85 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: 0abe5353-a09f-4fe0-a899-a4f72171e6da] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:53.835779 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9e96923b-0ca6-4aae-b6c6-a90810340b85 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:53.836278 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9e96923b-0ca6-4aae-b6c6-a90810340b85 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:53.836708 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9e96923b-0ca6-4aae-b6c6-a90810340b85 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:53.837397 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9e96923b-0ca6-4aae-b6c6-a90810340b85 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:53.838006 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9e96923b-0ca6-4aae-b6c6-a90810340b85 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:53.838579 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9e96923b-0ca6-4aae-b6c6-a90810340b85 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:53.994426 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-9e96923b-0ca6-4aae-b6c6-a90810340b85 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:54.002517 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-9e96923b-0ca6-4aae-b6c6-a90810340b85 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/0abe5353-a09f-4fe0-a899-a4f72171e6da" status: 200 len: 1313 microversion: 2.1 time: 0.177693 Sep 06 01:12:54.003098 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 100/194] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:53 2022] GET /compute/v2.1/servers/0abe5353-a09f-4fe0-a899-a4f72171e6da => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:12:54.096312 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-0401e7ab-7e97-4bcb-9268-15cf732798bd tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] validate_networks() for [('dcf25d1c-5a22-43e5-ace0-2f3939ca0a91', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 01:12:54.261431 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-8b49d563-20e4-4275-90b7-0f7dc22fba5a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:54.262422 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-8b49d563-20e4-4275-90b7-0f7dc22fba5a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:54.270133 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8b49d563-20e4-4275-90b7-0f7dc22fba5a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:54.270614 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8b49d563-20e4-4275-90b7-0f7dc22fba5a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:54.271596 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8b49d563-20e4-4275-90b7-0f7dc22fba5a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:54.272364 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8b49d563-20e4-4275-90b7-0f7dc22fba5a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:54.273024 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8b49d563-20e4-4275-90b7-0f7dc22fba5a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:54.273563 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8b49d563-20e4-4275-90b7-0f7dc22fba5a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:54.543742 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-8b49d563-20e4-4275-90b7-0f7dc22fba5a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:54.552946 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-8b49d563-20e4-4275-90b7-0f7dc22fba5a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1522 microversion: 2.1 time: 0.295336 Sep 06 01:12:54.554015 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 101/195] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:54 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:12:54.604219 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-0401e7ab-7e97-4bcb-9268-15cf732798bd tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 01:12:54.604641 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-0401e7ab-7e97-4bcb-9268-15cf732798bd tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 01:12:54.605103 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-0401e7ab-7e97-4bcb-9268-15cf732798bd tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 01:12:54.605689 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-0401e7ab-7e97-4bcb-9268-15cf732798bd tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 01:12:54.606097 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-0401e7ab-7e97-4bcb-9268-15cf732798bd tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 01:12:54.615294 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0401e7ab-7e97-4bcb-9268-15cf732798bd tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:54.615823 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0401e7ab-7e97-4bcb-9268-15cf732798bd tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:54.616453 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0401e7ab-7e97-4bcb-9268-15cf732798bd tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:54.617377 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0401e7ab-7e97-4bcb-9268-15cf732798bd tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:54.618017 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0401e7ab-7e97-4bcb-9268-15cf732798bd tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:54.619326 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0401e7ab-7e97-4bcb-9268-15cf732798bd tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:54.637157 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.quota [None req-0401e7ab-7e97-4bcb-9268-15cf732798bd tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Getting quotas for project 80cfec738cab491ba413e062b5a00813. Resources: {'instances', 'ram', 'cores'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 01:12:54.641619 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.quota [None req-0401e7ab-7e97-4bcb-9268-15cf732798bd tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Getting quotas for user e17a4e664b2c4ac9a9fea65287faad95 and project 80cfec738cab491ba413e062b5a00813. Resources: {'instances', 'ram', 'cores'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 01:12:54.653806 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0401e7ab-7e97-4bcb-9268-15cf732798bd tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 01:12:54.656328 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0401e7ab-7e97-4bcb-9268-15cf732798bd tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='768973cc-7b5f-4eed-b493-e40eb0de9f88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 01:12:54.718097 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0401e7ab-7e97-4bcb-9268-15cf732798bd tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.700585 Sep 06 01:12:54.719546 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 95/196] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Sep 6 01:12:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 1702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 01:12:54.730822 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-374ad34d-2932-4139-9165-cf8167188b12 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:54.731672 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-374ad34d-2932-4139-9165-cf8167188b12 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:54.793270 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-374ad34d-2932-4139-9165-cf8167188b12 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:54.801905 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-374ad34d-2932-4139-9165-cf8167188b12 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1236 microversion: 2.1 time: 0.075082 Sep 06 01:12:54.802395 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 102/197] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:54 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1236 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:55.025885 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-47a6fea9-8c05-4cdf-8572-e71d9f500e1c tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:55.026502 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-47a6fea9-8c05-4cdf-8572-e71d9f500e1c tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: 0abe5353-a09f-4fe0-a899-a4f72171e6da] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:55.033402 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47a6fea9-8c05-4cdf-8572-e71d9f500e1c tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:55.033884 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47a6fea9-8c05-4cdf-8572-e71d9f500e1c tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:55.034536 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47a6fea9-8c05-4cdf-8572-e71d9f500e1c tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:55.035223 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47a6fea9-8c05-4cdf-8572-e71d9f500e1c tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:55.035674 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47a6fea9-8c05-4cdf-8572-e71d9f500e1c tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:55.037063 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47a6fea9-8c05-4cdf-8572-e71d9f500e1c tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:55.205690 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-47a6fea9-8c05-4cdf-8572-e71d9f500e1c tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:55.214672 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-47a6fea9-8c05-4cdf-8572-e71d9f500e1c tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/0abe5353-a09f-4fe0-a899-a4f72171e6da" status: 200 len: 1313 microversion: 2.1 time: 0.193395 Sep 06 01:12:55.215252 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 96/198] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:55 2022] GET /compute/v2.1/servers/0abe5353-a09f-4fe0-a899-a4f72171e6da => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:55.581034 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-87ea993a-2a96-4852-8138-0dd5198fe5f5 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:55.584940 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-87ea993a-2a96-4852-8138-0dd5198fe5f5 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:55.590932 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-87ea993a-2a96-4852-8138-0dd5198fe5f5 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:55.591415 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-87ea993a-2a96-4852-8138-0dd5198fe5f5 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:55.591880 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-87ea993a-2a96-4852-8138-0dd5198fe5f5 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:55.592572 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-87ea993a-2a96-4852-8138-0dd5198fe5f5 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:55.593021 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-87ea993a-2a96-4852-8138-0dd5198fe5f5 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:55.593440 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-87ea993a-2a96-4852-8138-0dd5198fe5f5 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:55.729877 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-87ea993a-2a96-4852-8138-0dd5198fe5f5 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:55.743347 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-87ea993a-2a96-4852-8138-0dd5198fe5f5 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1522 microversion: 2.1 time: 0.165971 Sep 06 01:12:55.744284 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 103/199] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:55 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:55.825641 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d0339fd6-0f3f-4448-96ed-d871bd0ba2e4 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:55.826323 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d0339fd6-0f3f-4448-96ed-d871bd0ba2e4 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:55.833265 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0339fd6-0f3f-4448-96ed-d871bd0ba2e4 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:55.833750 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0339fd6-0f3f-4448-96ed-d871bd0ba2e4 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:55.834797 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0339fd6-0f3f-4448-96ed-d871bd0ba2e4 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:55.835666 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0339fd6-0f3f-4448-96ed-d871bd0ba2e4 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:55.836166 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0339fd6-0f3f-4448-96ed-d871bd0ba2e4 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:55.836547 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0339fd6-0f3f-4448-96ed-d871bd0ba2e4 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:55.898147 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-d0339fd6-0f3f-4448-96ed-d871bd0ba2e4 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:55.906048 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d0339fd6-0f3f-4448-96ed-d871bd0ba2e4 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1288 microversion: 2.1 time: 0.084572 Sep 06 01:12:55.906684 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 97/200] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:55 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1288 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:56.238405 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-4f40bf5a-7919-4b89-a23f-28d180ca4ced tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:56.239046 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-4f40bf5a-7919-4b89-a23f-28d180ca4ced tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: 0abe5353-a09f-4fe0-a899-a4f72171e6da] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:56.245305 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4f40bf5a-7919-4b89-a23f-28d180ca4ced tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:56.245798 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4f40bf5a-7919-4b89-a23f-28d180ca4ced tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:56.246225 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4f40bf5a-7919-4b89-a23f-28d180ca4ced tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:56.247069 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4f40bf5a-7919-4b89-a23f-28d180ca4ced tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:56.247681 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4f40bf5a-7919-4b89-a23f-28d180ca4ced tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:56.248121 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4f40bf5a-7919-4b89-a23f-28d180ca4ced tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:56.264479 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell0:SELECT=2 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:12:56.391403 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-4f40bf5a-7919-4b89-a23f-28d180ca4ced tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:56.406433 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-4f40bf5a-7919-4b89-a23f-28d180ca4ced tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/0abe5353-a09f-4fe0-a899-a4f72171e6da" status: 200 len: 1313 microversion: 2.1 time: 0.171755 Sep 06 01:12:56.407126 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 104/201] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:56 2022] GET /compute/v2.1/servers/0abe5353-a09f-4fe0-a899-a4f72171e6da => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:56.769325 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-af4cf49f-55bc-4548-816e-807868a695dc tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:56.771018 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-af4cf49f-55bc-4548-816e-807868a695dc tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:56.799459 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-af4cf49f-55bc-4548-816e-807868a695dc tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:56.800227 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-af4cf49f-55bc-4548-816e-807868a695dc tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:56.801041 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-af4cf49f-55bc-4548-816e-807868a695dc tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:56.801843 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-af4cf49f-55bc-4548-816e-807868a695dc tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:56.802515 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-af4cf49f-55bc-4548-816e-807868a695dc tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:56.803615 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-af4cf49f-55bc-4548-816e-807868a695dc tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:56.935643 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-b2abd4a2-61b6-4c86-bb00-b073395b534f tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:56.936566 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-b2abd4a2-61b6-4c86-bb00-b073395b534f tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:56.951658 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b2abd4a2-61b6-4c86-bb00-b073395b534f tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:56.952789 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b2abd4a2-61b6-4c86-bb00-b073395b534f tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:56.953663 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b2abd4a2-61b6-4c86-bb00-b073395b534f tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:56.954601 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b2abd4a2-61b6-4c86-bb00-b073395b534f tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:56.955212 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b2abd4a2-61b6-4c86-bb00-b073395b534f tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:56.955904 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b2abd4a2-61b6-4c86-bb00-b073395b534f tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:57.008479 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-af4cf49f-55bc-4548-816e-807868a695dc tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:57.017542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-af4cf49f-55bc-4548-816e-807868a695dc tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1522 microversion: 2.1 time: 0.254733 Sep 06 01:12:57.018735 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 98/202] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:56 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:57.042150 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-b2abd4a2-61b6-4c86-bb00-b073395b534f tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:57.051198 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-b2abd4a2-61b6-4c86-bb00-b073395b534f tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1294 microversion: 2.1 time: 0.123524 Sep 06 01:12:57.052256 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 105/203] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:56 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1294 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:57.429078 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-710e1544-bf33-4f01-8974-e8b5083ec3f4 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:57.429794 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-710e1544-bf33-4f01-8974-e8b5083ec3f4 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: 0abe5353-a09f-4fe0-a899-a4f72171e6da] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:57.436444 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-710e1544-bf33-4f01-8974-e8b5083ec3f4 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:57.436939 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-710e1544-bf33-4f01-8974-e8b5083ec3f4 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:57.437372 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-710e1544-bf33-4f01-8974-e8b5083ec3f4 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:57.438147 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-710e1544-bf33-4f01-8974-e8b5083ec3f4 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:57.438542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-710e1544-bf33-4f01-8974-e8b5083ec3f4 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:57.438971 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-710e1544-bf33-4f01-8974-e8b5083ec3f4 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:57.571134 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-710e1544-bf33-4f01-8974-e8b5083ec3f4 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:57.578862 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-710e1544-bf33-4f01-8974-e8b5083ec3f4 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/0abe5353-a09f-4fe0-a899-a4f72171e6da" status: 200 len: 1313 microversion: 2.1 time: 0.153649 Sep 06 01:12:57.584812 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 99/204] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:57 2022] GET /compute/v2.1/servers/0abe5353-a09f-4fe0-a899-a4f72171e6da => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:57.964042 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-ce9f0787-533d-41eb-8469-4a1bd3172a74 req-3f23ca39-eb72-4bef-963b-0f6c3f1c1165 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c116182e-e47e-4655-a30d-5f8d52772fba", "tag": "c1420767-f22f-45e4-9e34-63a18969b34d"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:12:57.974804 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-ce9f0787-533d-41eb-8469-4a1bd3172a74 req-3f23ca39-eb72-4bef-963b-0f6c3f1c1165 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:57.975512 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-ce9f0787-533d-41eb-8469-4a1bd3172a74 req-3f23ca39-eb72-4bef-963b-0f6c3f1c1165 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:57.976228 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-ce9f0787-533d-41eb-8469-4a1bd3172a74 req-3f23ca39-eb72-4bef-963b-0f6c3f1c1165 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:57.992496 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.compute.server_external_events [req-ce9f0787-533d-41eb-8469-4a1bd3172a74 req-3f23ca39-eb72-4bef-963b-0f6c3f1c1165 service nova] Creating event network-changed:c1420767-f22f-45e4-9e34-63a18969b34d for instance c116182e-e47e-4655-a30d-5f8d52772fba on hv-cinder-84773 Sep 06 01:12:57.998064 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [req-ce9f0787-533d-41eb-8469-4a1bd3172a74 req-3f23ca39-eb72-4bef-963b-0f6c3f1c1165 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038343 Sep 06 01:12:57.998841 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 106/205] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 01:12:58.041946 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-273b74fd-1637-41ed-9947-04a210dd72df tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:58.042641 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-273b74fd-1637-41ed-9947-04a210dd72df tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:58.050239 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-273b74fd-1637-41ed-9947-04a210dd72df tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:58.050821 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-273b74fd-1637-41ed-9947-04a210dd72df tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:58.051606 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-273b74fd-1637-41ed-9947-04a210dd72df tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:58.052349 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-273b74fd-1637-41ed-9947-04a210dd72df tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:58.053322 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-273b74fd-1637-41ed-9947-04a210dd72df tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:58.053755 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-273b74fd-1637-41ed-9947-04a210dd72df tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:58.076856 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-89190932-4b29-464f-b2d6-7769cfa1c313 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:58.078420 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-89190932-4b29-464f-b2d6-7769cfa1c313 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:58.096757 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-89190932-4b29-464f-b2d6-7769cfa1c313 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:58.097355 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-89190932-4b29-464f-b2d6-7769cfa1c313 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:58.098028 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-89190932-4b29-464f-b2d6-7769cfa1c313 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:58.099214 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-89190932-4b29-464f-b2d6-7769cfa1c313 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:58.100164 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-89190932-4b29-464f-b2d6-7769cfa1c313 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:58.101255 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-89190932-4b29-464f-b2d6-7769cfa1c313 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:58.568995 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-273b74fd-1637-41ed-9947-04a210dd72df tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:58.582723 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-273b74fd-1637-41ed-9947-04a210dd72df tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1522 microversion: 2.1 time: 0.544091 Sep 06 01:12:58.583919 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 100/206] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:58 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1522 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:58.590573 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-4879997c-0050-4549-b618-ca711e4c62ac req-9605ec7e-9ba0-4339-aa00-c3b7deeb77ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0abe5353-a09f-4fe0-a899-a4f72171e6da", "name": "network-vif-plugged", "status": "completed", "tag": "5c2b7e5a-f039-44dc-a82d-dc5714f30e9d"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:12:58.592652 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-89190932-4b29-464f-b2d6-7769cfa1c313 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:58.600977 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-4879997c-0050-4549-b618-ca711e4c62ac req-9605ec7e-9ba0-4339-aa00-c3b7deeb77ed service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:58.601454 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-4879997c-0050-4549-b618-ca711e4c62ac req-9605ec7e-9ba0-4339-aa00-c3b7deeb77ed service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:58.601872 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-4879997c-0050-4549-b618-ca711e4c62ac req-9605ec7e-9ba0-4339-aa00-c3b7deeb77ed service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:58.603378 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-89190932-4b29-464f-b2d6-7769cfa1c313 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1362 microversion: 2.1 time: 0.531132 Sep 06 01:12:58.603984 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 107/207] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:58 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1362 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:58.610106 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-f051e9eb-f006-43b8-a534-fab25f8a5f07 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:58.610992 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-f051e9eb-f006-43b8-a534-fab25f8a5f07 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: 0abe5353-a09f-4fe0-a899-a4f72171e6da] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:58.616760 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-4879997c-0050-4549-b618-ca711e4c62ac req-9605ec7e-9ba0-4339-aa00-c3b7deeb77ed service nova] Creating event network-vif-plugged:5c2b7e5a-f039-44dc-a82d-dc5714f30e9d for instance 0abe5353-a09f-4fe0-a899-a4f72171e6da on hv-cinder-84773 Sep 06 01:12:58.617834 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f051e9eb-f006-43b8-a534-fab25f8a5f07 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:58.618474 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f051e9eb-f006-43b8-a534-fab25f8a5f07 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:58.619046 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f051e9eb-f006-43b8-a534-fab25f8a5f07 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:58.619923 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f051e9eb-f006-43b8-a534-fab25f8a5f07 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:58.620661 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f051e9eb-f006-43b8-a534-fab25f8a5f07 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:58.621245 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f051e9eb-f006-43b8-a534-fab25f8a5f07 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:58.621983 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-4879997c-0050-4549-b618-ca711e4c62ac req-9605ec7e-9ba0-4339-aa00-c3b7deeb77ed service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036446 Sep 06 01:12:58.622638 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 101/208] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:12:58.749194 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-f051e9eb-f006-43b8-a534-fab25f8a5f07 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:58.757780 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-f051e9eb-f006-43b8-a534-fab25f8a5f07 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/0abe5353-a09f-4fe0-a899-a4f72171e6da" status: 200 len: 1313 microversion: 2.1 time: 0.152032 Sep 06 01:12:58.758327 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 108/209] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:58 2022] GET /compute/v2.1/servers/0abe5353-a09f-4fe0-a899-a4f72171e6da => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:59.607790 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b93a52cb-8b56-4b5b-af25-b88cb175a6e4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:59.608487 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b93a52cb-8b56-4b5b-af25-b88cb175a6e4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:59.614550 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b93a52cb-8b56-4b5b-af25-b88cb175a6e4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:59.615032 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b93a52cb-8b56-4b5b-af25-b88cb175a6e4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:59.615988 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b93a52cb-8b56-4b5b-af25-b88cb175a6e4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:59.616675 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b93a52cb-8b56-4b5b-af25-b88cb175a6e4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:59.617131 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b93a52cb-8b56-4b5b-af25-b88cb175a6e4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:59.617556 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b93a52cb-8b56-4b5b-af25-b88cb175a6e4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:59.628580 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-fc171436-2530-4d51-8496-0c6671d7bec9 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:59.629381 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-fc171436-2530-4d51-8496-0c6671d7bec9 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:59.636270 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fc171436-2530-4d51-8496-0c6671d7bec9 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:59.637068 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fc171436-2530-4d51-8496-0c6671d7bec9 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:59.637831 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fc171436-2530-4d51-8496-0c6671d7bec9 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:59.638890 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fc171436-2530-4d51-8496-0c6671d7bec9 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:59.639813 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fc171436-2530-4d51-8496-0c6671d7bec9 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:59.640554 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fc171436-2530-4d51-8496-0c6671d7bec9 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:59.836693 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-b93a52cb-8b56-4b5b-af25-b88cb175a6e4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:59.842792 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-fc171436-2530-4d51-8496-0c6671d7bec9 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:12:59.845665 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b93a52cb-8b56-4b5b-af25-b88cb175a6e4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1522 microversion: 2.1 time: 0.242932 Sep 06 01:12:59.846254 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 102/210] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:59 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:12:59.851499 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-fc171436-2530-4d51-8496-0c6671d7bec9 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1362 microversion: 2.1 time: 0.226599 Sep 06 01:12:59.851886 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f40445b0-1040-4182-89ce-a26f58ef652e tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:12:59.863775 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f40445b0-1040-4182-89ce-a26f58ef652e tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: 0abe5353-a09f-4fe0-a899-a4f72171e6da] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:12:59.863775 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f40445b0-1040-4182-89ce-a26f58ef652e tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:59.863775 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f40445b0-1040-4182-89ce-a26f58ef652e tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:59.863775 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f40445b0-1040-4182-89ce-a26f58ef652e tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:59.864202 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f40445b0-1040-4182-89ce-a26f58ef652e tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:12:59.864202 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f40445b0-1040-4182-89ce-a26f58ef652e tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:12:59.864202 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f40445b0-1040-4182-89ce-a26f58ef652e tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:12:59.864745 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 109/211] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:59 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:13:00.049153 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-f40445b0-1040-4182-89ce-a26f58ef652e tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:00.060993 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f40445b0-1040-4182-89ce-a26f58ef652e tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/0abe5353-a09f-4fe0-a899-a4f72171e6da" status: 200 len: 1313 microversion: 2.1 time: 0.213432 Sep 06 01:13:00.062609 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 103/212] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:12:59 2022] GET /compute/v2.1/servers/0abe5353-a09f-4fe0-a899-a4f72171e6da => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:00.870106 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-6f2b5ec9-9728-4fc7-817e-05c51c060908 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:00.871003 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-6f2b5ec9-9728-4fc7-817e-05c51c060908 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:00.875152 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ed89259f-4d1f-42b2-ab36-83c8467ea72a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:00.875780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ed89259f-4d1f-42b2-ab36-83c8467ea72a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:00.876974 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6f2b5ec9-9728-4fc7-817e-05c51c060908 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:00.877461 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6f2b5ec9-9728-4fc7-817e-05c51c060908 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:00.877894 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6f2b5ec9-9728-4fc7-817e-05c51c060908 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:00.878607 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6f2b5ec9-9728-4fc7-817e-05c51c060908 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:00.879214 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6f2b5ec9-9728-4fc7-817e-05c51c060908 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:00.879822 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6f2b5ec9-9728-4fc7-817e-05c51c060908 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:00.882513 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ed89259f-4d1f-42b2-ab36-83c8467ea72a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:00.883027 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ed89259f-4d1f-42b2-ab36-83c8467ea72a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:00.883717 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ed89259f-4d1f-42b2-ab36-83c8467ea72a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:00.884434 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ed89259f-4d1f-42b2-ab36-83c8467ea72a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:00.884884 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ed89259f-4d1f-42b2-ab36-83c8467ea72a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:00.885459 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ed89259f-4d1f-42b2-ab36-83c8467ea72a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:01.095102 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-6f2b5ec9-9728-4fc7-817e-05c51c060908 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:01.103518 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-ed89259f-4d1f-42b2-ab36-83c8467ea72a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:01.104134 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-6f2b5ec9-9728-4fc7-817e-05c51c060908 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1522 microversion: 2.1 time: 0.238638 Sep 06 01:13:01.105148 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 110/213] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:00 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:01.111713 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ed89259f-4d1f-42b2-ab36-83c8467ea72a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1362 microversion: 2.1 time: 0.240615 Sep 06 01:13:01.114160 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 104/214] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:00 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1362 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:13:01.119741 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-057cba4c-5f21-4dae-a9b7-9dd351083042 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:01.120389 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-057cba4c-5f21-4dae-a9b7-9dd351083042 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: 0abe5353-a09f-4fe0-a899-a4f72171e6da] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:01.129259 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-057cba4c-5f21-4dae-a9b7-9dd351083042 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:01.129907 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-057cba4c-5f21-4dae-a9b7-9dd351083042 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:01.130350 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-057cba4c-5f21-4dae-a9b7-9dd351083042 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:01.131121 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-057cba4c-5f21-4dae-a9b7-9dd351083042 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:01.132333 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-057cba4c-5f21-4dae-a9b7-9dd351083042 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:01.132333 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-057cba4c-5f21-4dae-a9b7-9dd351083042 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:01.272689 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-057cba4c-5f21-4dae-a9b7-9dd351083042 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:01.280748 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-057cba4c-5f21-4dae-a9b7-9dd351083042 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/0abe5353-a09f-4fe0-a899-a4f72171e6da" status: 200 len: 1313 microversion: 2.1 time: 0.174415 Sep 06 01:13:01.281522 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 111/215] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:01 2022] GET /compute/v2.1/servers/0abe5353-a09f-4fe0-a899-a4f72171e6da => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:02.126712 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8c62b4e0-77a4-4df0-8db3-a12ef1196d4e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:02.127314 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8c62b4e0-77a4-4df0-8db3-a12ef1196d4e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:02.134854 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c62b4e0-77a4-4df0-8db3-a12ef1196d4e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:02.135337 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c62b4e0-77a4-4df0-8db3-a12ef1196d4e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:02.135785 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c62b4e0-77a4-4df0-8db3-a12ef1196d4e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:02.136376 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-fed64f93-68c0-4b8b-908d-e0a234ca93af tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:02.136802 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c62b4e0-77a4-4df0-8db3-a12ef1196d4e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:02.136970 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c62b4e0-77a4-4df0-8db3-a12ef1196d4e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:02.137327 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c62b4e0-77a4-4df0-8db3-a12ef1196d4e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:02.137979 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-fed64f93-68c0-4b8b-908d-e0a234ca93af tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:02.144339 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fed64f93-68c0-4b8b-908d-e0a234ca93af tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:02.145360 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fed64f93-68c0-4b8b-908d-e0a234ca93af tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:02.146057 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fed64f93-68c0-4b8b-908d-e0a234ca93af tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:02.147093 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fed64f93-68c0-4b8b-908d-e0a234ca93af tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:02.147780 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fed64f93-68c0-4b8b-908d-e0a234ca93af tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:02.148418 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fed64f93-68c0-4b8b-908d-e0a234ca93af tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:02.399446 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-fed64f93-68c0-4b8b-908d-e0a234ca93af tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:02.411840 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-fed64f93-68c0-4b8b-908d-e0a234ca93af tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1362 microversion: 2.1 time: 0.279731 Sep 06 01:13:02.424882 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 112/216] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:02 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1362 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:13:02.440712 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-8c62b4e0-77a4-4df0-8db3-a12ef1196d4e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:02.441305 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-6500e84f-2350-4f47-ab30-3732d573b814 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:02.441943 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-6500e84f-2350-4f47-ab30-3732d573b814 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: 0abe5353-a09f-4fe0-a899-a4f72171e6da] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:02.456763 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8c62b4e0-77a4-4df0-8db3-a12ef1196d4e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1522 microversion: 2.1 time: 0.333604 Sep 06 01:13:02.458163 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 105/217] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:02 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1522 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:02.459888 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6500e84f-2350-4f47-ab30-3732d573b814 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:02.460506 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6500e84f-2350-4f47-ab30-3732d573b814 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:02.460970 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6500e84f-2350-4f47-ab30-3732d573b814 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:02.461703 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6500e84f-2350-4f47-ab30-3732d573b814 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:02.462976 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6500e84f-2350-4f47-ab30-3732d573b814 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:02.463405 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6500e84f-2350-4f47-ab30-3732d573b814 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:02.497853 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell1:SELECT=100 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:02.636396 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-6500e84f-2350-4f47-ab30-3732d573b814 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:02.645021 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-6500e84f-2350-4f47-ab30-3732d573b814 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/0abe5353-a09f-4fe0-a899-a4f72171e6da" status: 200 len: 1497 microversion: 2.1 time: 0.218477 Sep 06 01:13:02.645607 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 113/218] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:02 2022] GET /compute/v2.1/servers/0abe5353-a09f-4fe0-a899-a4f72171e6da => generated 1497 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:03.226559 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1c766e20-9410-45a3-9eb8-3abd767f61c7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:03.227778 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1c766e20-9410-45a3-9eb8-3abd767f61c7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: 0abe5353-a09f-4fe0-a899-a4f72171e6da] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:03.234313 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1c766e20-9410-45a3-9eb8-3abd767f61c7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:03.234918 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1c766e20-9410-45a3-9eb8-3abd767f61c7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:03.235449 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1c766e20-9410-45a3-9eb8-3abd767f61c7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:03.236282 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1c766e20-9410-45a3-9eb8-3abd767f61c7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:03.236743 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1c766e20-9410-45a3-9eb8-3abd767f61c7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:03.237169 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1c766e20-9410-45a3-9eb8-3abd767f61c7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:03.264139 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1c766e20-9410-45a3-9eb8-3abd767f61c7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: 0abe5353-a09f-4fe0-a899-a4f72171e6da] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 01:13:03.357338 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1c766e20-9410-45a3-9eb8-3abd767f61c7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0abe5353-a09f-4fe0-a899-a4f72171e6da" status: 204 len: 0 microversion: 2.1 time: 0.134773 Sep 06 01:13:03.369564 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 106/219] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 6 01:13:03 2022] DELETE /compute/v2.1/servers/0abe5353-a09f-4fe0-a899-a4f72171e6da => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 01:13:03.377619 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-dccad3ee-288c-4453-842e-39a36a107dfe tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:03.378870 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-dccad3ee-288c-4453-842e-39a36a107dfe tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: 0abe5353-a09f-4fe0-a899-a4f72171e6da] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:03.385758 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dccad3ee-288c-4453-842e-39a36a107dfe tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:03.386250 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dccad3ee-288c-4453-842e-39a36a107dfe tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:03.386686 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dccad3ee-288c-4453-842e-39a36a107dfe tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:03.387392 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dccad3ee-288c-4453-842e-39a36a107dfe tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:03.387889 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dccad3ee-288c-4453-842e-39a36a107dfe tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:03.388350 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dccad3ee-288c-4453-842e-39a36a107dfe tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:03.442392 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2d2fc4e9-1c7c-4c54-b787-40c68dace3f5 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:03.443375 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2d2fc4e9-1c7c-4c54-b787-40c68dace3f5 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:03.450008 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2d2fc4e9-1c7c-4c54-b787-40c68dace3f5 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:03.450506 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2d2fc4e9-1c7c-4c54-b787-40c68dace3f5 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:03.450961 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2d2fc4e9-1c7c-4c54-b787-40c68dace3f5 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:03.451672 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2d2fc4e9-1c7c-4c54-b787-40c68dace3f5 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:03.452246 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2d2fc4e9-1c7c-4c54-b787-40c68dace3f5 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:03.452679 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2d2fc4e9-1c7c-4c54-b787-40c68dace3f5 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:03.476134 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:03.658154 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-dccad3ee-288c-4453-842e-39a36a107dfe tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:03.667316 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-dccad3ee-288c-4453-842e-39a36a107dfe tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/0abe5353-a09f-4fe0-a899-a4f72171e6da" status: 200 len: 1503 microversion: 2.1 time: 0.293417 Sep 06 01:13:03.668083 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 114/220] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:03 2022] GET /compute/v2.1/servers/0abe5353-a09f-4fe0-a899-a4f72171e6da => generated 1503 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:03.675993 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-2d2fc4e9-1c7c-4c54-b787-40c68dace3f5 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:03.681528 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-1eb8cc78-03c5-407e-acc8-5b7cc31592c3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:03.682200 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-1eb8cc78-03c5-407e-acc8-5b7cc31592c3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:03.689158 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1eb8cc78-03c5-407e-acc8-5b7cc31592c3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:03.689784 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1eb8cc78-03c5-407e-acc8-5b7cc31592c3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:03.690227 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1eb8cc78-03c5-407e-acc8-5b7cc31592c3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:03.690931 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1eb8cc78-03c5-407e-acc8-5b7cc31592c3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:03.691388 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1eb8cc78-03c5-407e-acc8-5b7cc31592c3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:03.691733 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2d2fc4e9-1c7c-4c54-b787-40c68dace3f5 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1362 microversion: 2.1 time: 0.253834 Sep 06 01:13:03.691870 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1eb8cc78-03c5-407e-acc8-5b7cc31592c3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:03.692510 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 107/221] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:03 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1362 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:03.860473 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-1eb8cc78-03c5-407e-acc8-5b7cc31592c3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:03.868749 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-1eb8cc78-03c5-407e-acc8-5b7cc31592c3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1522 microversion: 2.1 time: 0.191175 Sep 06 01:13:03.869641 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 115/222] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:03 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:04.242659 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-a8cf9b6b-c503-46eb-ab94-c9547542e97d req-aafdd796-82bb-4fbf-9d9d-01a05391f8fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c116182e-e47e-4655-a30d-5f8d52772fba", "name": "network-vif-plugged", "status": "completed", "tag": "c1420767-f22f-45e4-9e34-63a18969b34d"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:13:04.253380 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a8cf9b6b-c503-46eb-ab94-c9547542e97d req-aafdd796-82bb-4fbf-9d9d-01a05391f8fb service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:04.254085 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a8cf9b6b-c503-46eb-ab94-c9547542e97d req-aafdd796-82bb-4fbf-9d9d-01a05391f8fb service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:04.254889 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a8cf9b6b-c503-46eb-ab94-c9547542e97d req-aafdd796-82bb-4fbf-9d9d-01a05391f8fb service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:04.267866 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-a8cf9b6b-c503-46eb-ab94-c9547542e97d req-aafdd796-82bb-4fbf-9d9d-01a05391f8fb service nova] Creating event network-vif-plugged:c1420767-f22f-45e4-9e34-63a18969b34d for instance c116182e-e47e-4655-a30d-5f8d52772fba on hv-cinder-84773 Sep 06 01:13:04.273113 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-a8cf9b6b-c503-46eb-ab94-c9547542e97d req-aafdd796-82bb-4fbf-9d9d-01a05391f8fb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035369 Sep 06 01:13:04.273815 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 108/223] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:13:04.690469 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-6c7de6c9-901e-425c-8181-65f5132f783b tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:04.691237 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-6c7de6c9-901e-425c-8181-65f5132f783b tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: 0abe5353-a09f-4fe0-a899-a4f72171e6da] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:04.697091 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6c7de6c9-901e-425c-8181-65f5132f783b tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:04.697574 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6c7de6c9-901e-425c-8181-65f5132f783b tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:04.698006 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6c7de6c9-901e-425c-8181-65f5132f783b tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:04.698691 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6c7de6c9-901e-425c-8181-65f5132f783b tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:04.699145 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6c7de6c9-901e-425c-8181-65f5132f783b tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:04.699596 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6c7de6c9-901e-425c-8181-65f5132f783b tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:04.712901 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:04.713674 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=12 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:04.718998 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a16bfea8-740d-4503-be68-75a5f41c594c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:04.719880 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a16bfea8-740d-4503-be68-75a5f41c594c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:04.730502 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a16bfea8-740d-4503-be68-75a5f41c594c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:04.731002 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a16bfea8-740d-4503-be68-75a5f41c594c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:04.731603 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a16bfea8-740d-4503-be68-75a5f41c594c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:04.732539 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a16bfea8-740d-4503-be68-75a5f41c594c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:04.733141 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a16bfea8-740d-4503-be68-75a5f41c594c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:04.733573 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a16bfea8-740d-4503-be68-75a5f41c594c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:04.798980 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell0:SELECT=8 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:04.925666 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-6c7de6c9-901e-425c-8181-65f5132f783b tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:04.937208 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-6c7de6c9-901e-425c-8181-65f5132f783b tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/0abe5353-a09f-4fe0-a899-a4f72171e6da" status: 200 len: 1503 microversion: 2.1 time: 0.250478 Sep 06 01:13:04.938095 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 116/224] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:04 2022] GET /compute/v2.1/servers/0abe5353-a09f-4fe0-a899-a4f72171e6da => generated 1503 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:04.942470 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-a16bfea8-740d-4503-be68-75a5f41c594c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:04.955638 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-752f5620-ff6d-4688-9735-a9cfdd438cb1 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:04.956291 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-752f5620-ff6d-4688-9735-a9cfdd438cb1 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:04.956972 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a16bfea8-740d-4503-be68-75a5f41c594c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1362 microversion: 2.1 time: 0.239115 Sep 06 01:13:04.957590 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 109/225] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:04 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1362 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:13:04.964540 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-752f5620-ff6d-4688-9735-a9cfdd438cb1 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:04.965490 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-752f5620-ff6d-4688-9735-a9cfdd438cb1 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:04.966251 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-752f5620-ff6d-4688-9735-a9cfdd438cb1 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:04.967237 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-752f5620-ff6d-4688-9735-a9cfdd438cb1 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:04.967886 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-752f5620-ff6d-4688-9735-a9cfdd438cb1 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:04.968713 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-752f5620-ff6d-4688-9735-a9cfdd438cb1 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:05.116178 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-752f5620-ff6d-4688-9735-a9cfdd438cb1 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:05.124736 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-752f5620-ff6d-4688-9735-a9cfdd438cb1 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1522 microversion: 2.1 time: 0.172838 Sep 06 01:13:05.125457 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 117/226] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:04 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:05.961817 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4f94df9e-cea7-448c-9530-8e0a21146329 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:05.962549 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4f94df9e-cea7-448c-9530-8e0a21146329 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: 0abe5353-a09f-4fe0-a899-a4f72171e6da] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:05.965111 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:05.970988 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f94df9e-cea7-448c-9530-8e0a21146329 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:05.971580 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f94df9e-cea7-448c-9530-8e0a21146329 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:05.972115 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f94df9e-cea7-448c-9530-8e0a21146329 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:05.972922 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f94df9e-cea7-448c-9530-8e0a21146329 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:05.973451 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f94df9e-cea7-448c-9530-8e0a21146329 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:05.973878 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f94df9e-cea7-448c-9530-8e0a21146329 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:05.982178 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-180e826b-f3d6-40a7-bfeb-ae3e46c103e3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:05.983525 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-180e826b-f3d6-40a7-bfeb-ae3e46c103e3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:05.990832 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-180e826b-f3d6-40a7-bfeb-ae3e46c103e3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:05.991422 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-180e826b-f3d6-40a7-bfeb-ae3e46c103e3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:05.991989 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-180e826b-f3d6-40a7-bfeb-ae3e46c103e3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:05.992781 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-180e826b-f3d6-40a7-bfeb-ae3e46c103e3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:05.993300 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-180e826b-f3d6-40a7-bfeb-ae3e46c103e3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:05.993726 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-180e826b-f3d6-40a7-bfeb-ae3e46c103e3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:06.058025 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-4f94df9e-cea7-448c-9530-8e0a21146329 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:06.074396 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4f94df9e-cea7-448c-9530-8e0a21146329 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/0abe5353-a09f-4fe0-a899-a4f72171e6da" status: 200 len: 1461 microversion: 2.1 time: 0.116269 Sep 06 01:13:06.076048 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 110/227] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:05 2022] GET /compute/v2.1/servers/0abe5353-a09f-4fe0-a899-a4f72171e6da => generated 1461 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:06.148392 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5d24275e-b024-4ed0-96c9-c57f3cb485a9 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:06.149147 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5d24275e-b024-4ed0-96c9-c57f3cb485a9 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:06.160053 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-180e826b-f3d6-40a7-bfeb-ae3e46c103e3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:06.164378 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5d24275e-b024-4ed0-96c9-c57f3cb485a9 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:06.164870 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5d24275e-b024-4ed0-96c9-c57f3cb485a9 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:06.165474 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5d24275e-b024-4ed0-96c9-c57f3cb485a9 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:06.166400 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5d24275e-b024-4ed0-96c9-c57f3cb485a9 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:06.166857 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5d24275e-b024-4ed0-96c9-c57f3cb485a9 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:06.167275 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5d24275e-b024-4ed0-96c9-c57f3cb485a9 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:06.170810 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-180e826b-f3d6-40a7-bfeb-ae3e46c103e3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1362 microversion: 2.1 time: 0.192922 Sep 06 01:13:06.184363 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 118/228] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:05 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:13:06.192403 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-a4a5ead7-dce3-4325-b2b3-8b5ccd3e246c req-26e9cdd6-1196-4ec7-ac69-dd12e12742ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0abe5353-a09f-4fe0-a899-a4f72171e6da", "name": "network-vif-deleted", "tag": "5c2b7e5a-f039-44dc-a82d-dc5714f30e9d"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:13:06.203208 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-a4a5ead7-dce3-4325-b2b3-8b5ccd3e246c req-26e9cdd6-1196-4ec7-ac69-dd12e12742ec service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:06.203678 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-a4a5ead7-dce3-4325-b2b3-8b5ccd3e246c req-26e9cdd6-1196-4ec7-ac69-dd12e12742ec service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:06.204151 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-a4a5ead7-dce3-4325-b2b3-8b5ccd3e246c req-26e9cdd6-1196-4ec7-ac69-dd12e12742ec service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:06.215815 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.compute.server_external_events [req-a4a5ead7-dce3-4325-b2b3-8b5ccd3e246c req-26e9cdd6-1196-4ec7-ac69-dd12e12742ec service nova] Creating event network-vif-deleted:5c2b7e5a-f039-44dc-a82d-dc5714f30e9d for instance 0abe5353-a09f-4fe0-a899-a4f72171e6da on hv-cinder-84773 Sep 06 01:13:06.221726 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [req-a4a5ead7-dce3-4325-b2b3-8b5ccd3e246c req-26e9cdd6-1196-4ec7-ac69-dd12e12742ec service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036103 Sep 06 01:13:06.222561 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 119/229] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:13:06.315823 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-5d24275e-b024-4ed0-96c9-c57f3cb485a9 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:06.323405 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5d24275e-b024-4ed0-96c9-c57f3cb485a9 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1522 microversion: 2.1 time: 0.179432 Sep 06 01:13:06.323997 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 111/230] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:06 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:13:07.101331 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-47f09cad-8028-432e-a01f-70ba765e7fa5 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:07.102127 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-47f09cad-8028-432e-a01f-70ba765e7fa5 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: 0abe5353-a09f-4fe0-a899-a4f72171e6da] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:07.104348 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:07.110648 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-47f09cad-8028-432e-a01f-70ba765e7fa5 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:07.111557 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-47f09cad-8028-432e-a01f-70ba765e7fa5 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:07.112045 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-47f09cad-8028-432e-a01f-70ba765e7fa5 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:07.112910 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-47f09cad-8028-432e-a01f-70ba765e7fa5 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:07.113359 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-47f09cad-8028-432e-a01f-70ba765e7fa5 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:07.114096 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-47f09cad-8028-432e-a01f-70ba765e7fa5 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:07.147185 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-47f09cad-8028-432e-a01f-70ba765e7fa5 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:07.147569 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-47f09cad-8028-432e-a01f-70ba765e7fa5 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:07.148035 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-47f09cad-8028-432e-a01f-70ba765e7fa5 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:07.148486 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.objects.instance [None req-47f09cad-8028-432e-a01f-70ba765e7fa5 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lazy-loading 'fault' on Instance uuid 0abe5353-a09f-4fe0-a899-a4f72171e6da {{(pid=120580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 01:13:07.194770 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-47f09cad-8028-432e-a01f-70ba765e7fa5 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:07.198833 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-558a6ea8-533d-4f45-8468-eb8cd6b7604c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:07.199439 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-558a6ea8-533d-4f45-8468-eb8cd6b7604c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:07.202710 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-47f09cad-8028-432e-a01f-70ba765e7fa5 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/0abe5353-a09f-4fe0-a899-a4f72171e6da" status: 200 len: 1303 microversion: 2.1 time: 0.106276 Sep 06 01:13:07.203537 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 120/231] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:07 2022] GET /compute/v2.1/servers/0abe5353-a09f-4fe0-a899-a4f72171e6da => generated 1303 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:07.206300 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-558a6ea8-533d-4f45-8468-eb8cd6b7604c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:07.206785 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-558a6ea8-533d-4f45-8468-eb8cd6b7604c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:07.208977 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-558a6ea8-533d-4f45-8468-eb8cd6b7604c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:07.209727 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-558a6ea8-533d-4f45-8468-eb8cd6b7604c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:07.210190 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-558a6ea8-533d-4f45-8468-eb8cd6b7604c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:07.210613 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-558a6ea8-533d-4f45-8468-eb8cd6b7604c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:07.346403 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-7b3a1206-bec4-4fd5-a8d6-a7fd1f3203f5 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:07.347059 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-7b3a1206-bec4-4fd5-a8d6-a7fd1f3203f5 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:07.349586 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-558a6ea8-533d-4f45-8468-eb8cd6b7604c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:07.354910 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7b3a1206-bec4-4fd5-a8d6-a7fd1f3203f5 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:07.355979 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7b3a1206-bec4-4fd5-a8d6-a7fd1f3203f5 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:07.357180 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7b3a1206-bec4-4fd5-a8d6-a7fd1f3203f5 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:07.358643 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-558a6ea8-533d-4f45-8468-eb8cd6b7604c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1548 microversion: 2.1 time: 0.163553 Sep 06 01:13:07.359792 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 112/232] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:07 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:13:07.364080 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7b3a1206-bec4-4fd5-a8d6-a7fd1f3203f5 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:07.364633 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7b3a1206-bec4-4fd5-a8d6-a7fd1f3203f5 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:07.366498 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7b3a1206-bec4-4fd5-a8d6-a7fd1f3203f5 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:07.382541 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d0312da3-e8d8-4daa-a3fc-3e87c387cd7f tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:07.383035 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d0312da3-e8d8-4daa-a3fc-3e87c387cd7f tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:07.389186 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0312da3-e8d8-4daa-a3fc-3e87c387cd7f tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:07.389666 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0312da3-e8d8-4daa-a3fc-3e87c387cd7f tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:07.390103 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0312da3-e8d8-4daa-a3fc-3e87c387cd7f tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:07.390790 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0312da3-e8d8-4daa-a3fc-3e87c387cd7f tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:07.391243 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0312da3-e8d8-4daa-a3fc-3e87c387cd7f tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:07.391666 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0312da3-e8d8-4daa-a3fc-3e87c387cd7f tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:07.497625 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d0312da3-e8d8-4daa-a3fc-3e87c387cd7f tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.119449 Sep 06 01:13:07.498725 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 113/233] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Sep 6 01:13:07 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba/os-interface => generated 284 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 01:13:07.537554 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-7b3a1206-bec4-4fd5-a8d6-a7fd1f3203f5 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:07.546119 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-7b3a1206-bec4-4fd5-a8d6-a7fd1f3203f5 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1522 microversion: 2.1 time: 0.203578 Sep 06 01:13:07.546702 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 121/234] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:07 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:13:08.226429 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9f47234d-3593-4384-a627-64f6d24f9488 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:08.227246 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9f47234d-3593-4384-a627-64f6d24f9488 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: 0abe5353-a09f-4fe0-a899-a4f72171e6da] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:08.235445 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f47234d-3593-4384-a627-64f6d24f9488 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:08.236189 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f47234d-3593-4384-a627-64f6d24f9488 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:08.236872 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f47234d-3593-4384-a627-64f6d24f9488 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:08.237793 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f47234d-3593-4384-a627-64f6d24f9488 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:08.238757 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f47234d-3593-4384-a627-64f6d24f9488 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:08.239633 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f47234d-3593-4384-a627-64f6d24f9488 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:08.256253 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-9f47234d-3593-4384-a627-64f6d24f9488 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] HTTP exception thrown: Instance 0abe5353-a09f-4fe0-a899-a4f72171e6da could not be found. Sep 06 01:13:08.258162 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9f47234d-3593-4384-a627-64f6d24f9488 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Request method failure captured: Sep 06 01:13:08.258162 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/0abe5353-a09f-4fe0-a899-a4f72171e6da HTTP/1.1 Sep 06 01:13:08.258162 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept: application/json Sep 06 01:13:08.258162 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept-Encoding: identity Sep 06 01:13:08.258162 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Connection: close Sep 06 01:13:08.258162 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Length: 0 Sep 06 01:13:08.258162 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Type: application/json Sep 06 01:13:08.258162 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Host: 10.222.0.23 Sep 06 01:13:08.258162 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Openstack-System-Scope: None Sep 06 01:13:08.258162 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Sep 06 01:13:08.258162 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjFp6LbeL7MDdUpgnJe7S_Y7tWIvNshflAH_DTsWt8pTkMmTRgFq-_61Z93yDGdWz1AtE8dEEcq7W8sqXJq2wIeDZ_5JQEMHYRFAMW9xeXWDI1_jvvlHzEx6r62uW_XtcUMQ72fc8VeMYOiUzSamcwjeWlwKG4ibM1M0j8tzJ-r2sCAaA Sep 06 01:13:08.258162 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Id: None Sep 06 01:13:08.258162 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Name: None Sep 06 01:13:08.258162 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Identity-Status: Confirmed Sep 06 01:13:08.258162 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Is-Admin-Project: True Sep 06 01:13:08.258162 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Id: default Sep 06 01:13:08.258162 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Name: Default Sep 06 01:13:08.258162 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Id: 9ead4033c51d4658a5406c045da1c26e Sep 06 01:13:08.258162 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Name: tempest-VolumesActionsTest-86383368 Sep 06 01:13:08.258162 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Role: reader,member Sep 06 01:13:08.258162 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Roles: reader,member Sep 06 01:13:08.259716 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9ead4033c51d4658a5406c045da1c26e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9ead4033c51d4658a5406c045da1c26e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9ead4033c51d4658a5406c045da1c26e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9ead4033c51d4658a5406c045da1c26e"}]}] Sep 06 01:13:08.259716 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant: tempest-VolumesActionsTest-86383368 Sep 06 01:13:08.259716 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Id: 9ead4033c51d4658a5406c045da1c26e Sep 06 01:13:08.259716 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Name: tempest-VolumesActionsTest-86383368 Sep 06 01:13:08.259716 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User: tempest-VolumesActionsTest-86383368-project Sep 06 01:13:08.259716 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Id: default Sep 06 01:13:08.259716 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Name: Default Sep 06 01:13:08.259716 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Id: 453fa4c58743419bb29e5f01d9f78041 Sep 06 01:13:08.259716 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Name: tempest-VolumesActionsTest-86383368-project Sep 06 01:13:08.259716 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: method: > Sep 06 01:13:08.259716 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: exception: Instance 0abe5353-a09f-4fe0-a899-a4f72171e6da could not be found. Sep 06 01:13:08.259716 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: action_args: {'id': '0abe5353-a09f-4fe0-a899-a4f72171e6da'} Sep 06 01:13:08.260463 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:13:08.260463 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:13:08.260463 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 01:13:08.260463 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 01:13:08.260463 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 01:13:08.260463 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 01:13:08.260463 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 01:13:08.260463 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 01:13:08.260463 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 01:13:08.260463 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 01:13:08.260463 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0abe5353-a09f-4fe0-a899-a4f72171e6da could not be found. Sep 06 01:13:08.260463 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:13:08.260463 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:13:08.260463 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:13:08.260463 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:13:08.260463 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:13:08.260463 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:13:08.260463 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:13:08.260463 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:13:08.260463 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:13:08.261561 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:13:08.261561 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 01:13:08.261561 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 01:13:08.261561 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 01:13:08.261561 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 01:13:08.261561 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 01:13:08.261561 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:13:08.261561 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0abe5353-a09f-4fe0-a899-a4f72171e6da could not be found. Sep 06 01:13:08.261561 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:13:08.261561 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:13:08.261561 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:13:08.261561 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:13:08.261561 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:13:08.261561 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:13:08.261561 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:13:08.261561 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:13:08.261561 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0abe5353-a09f-4fe0-a899-a4f72171e6da could not be found. Sep 06 01:13:08.261561 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:13:08.262503 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9f47234d-3593-4384-a627-64f6d24f9488 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Returning 404 to user: Instance 0abe5353-a09f-4fe0-a899-a4f72171e6da could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:13:08.262503 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9f47234d-3593-4384-a627-64f6d24f9488 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/0abe5353-a09f-4fe0-a899-a4f72171e6da" status: 404 len: 111 microversion: 2.1 time: 0.040135 Sep 06 01:13:08.263370 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 114/235] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:08 2022] GET /compute/v2.1/servers/0abe5353-a09f-4fe0-a899-a4f72171e6da => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 01:13:08.384678 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-b6785c82-e112-45b3-908d-a9a334596b12 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-558479781", "imageRef": "768973cc-7b5f-4eed-b493-e40eb0de9f88", "flavorRef": "452", "networks": [{"uuid": "61626a63-787f-48a9-bed6-847e96c21b9d"}]}} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:13:08.440328 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.network.neutron [None req-b6785c82-e112-45b3-908d-a9a334596b12 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] validate_networks() for [('61626a63-787f-48a9-bed6-847e96c21b9d', None, None, None, None, None)] {{(pid=120580) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 01:13:08.578995 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0160e031-d3dc-4380-a34f-533a0ac269e4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:08.578995 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0160e031-d3dc-4380-a34f-533a0ac269e4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:08.589405 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0160e031-d3dc-4380-a34f-533a0ac269e4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:08.589545 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0160e031-d3dc-4380-a34f-533a0ac269e4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:08.590598 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0160e031-d3dc-4380-a34f-533a0ac269e4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:08.593351 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0160e031-d3dc-4380-a34f-533a0ac269e4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:08.593939 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0160e031-d3dc-4380-a34f-533a0ac269e4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:08.601710 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0160e031-d3dc-4380-a34f-533a0ac269e4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:08.984448 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-0160e031-d3dc-4380-a34f-533a0ac269e4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:08.993723 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0160e031-d3dc-4380-a34f-533a0ac269e4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1522 microversion: 2.1 time: 0.427315 Sep 06 01:13:09.007777 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 115/236] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:08 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1522 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:13:09.007777 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-e71dfddd-ff7b-40e8-8262-811fcb0aca61 req-5a1ea453-c17e-4e44-8051-0caf861ade48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c116182e-e47e-4655-a30d-5f8d52772fba", "tag": "c1420767-f22f-45e4-9e34-63a18969b34d"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:13:09.010732 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e71dfddd-ff7b-40e8-8262-811fcb0aca61 req-5a1ea453-c17e-4e44-8051-0caf861ade48 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:09.010732 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e71dfddd-ff7b-40e8-8262-811fcb0aca61 req-5a1ea453-c17e-4e44-8051-0caf861ade48 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:09.010732 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e71dfddd-ff7b-40e8-8262-811fcb0aca61 req-5a1ea453-c17e-4e44-8051-0caf861ade48 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:09.022746 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-e71dfddd-ff7b-40e8-8262-811fcb0aca61 req-5a1ea453-c17e-4e44-8051-0caf861ade48 service nova] Creating event network-changed:c1420767-f22f-45e4-9e34-63a18969b34d for instance c116182e-e47e-4655-a30d-5f8d52772fba on hv-cinder-84773 Sep 06 01:13:09.029176 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-e71dfddd-ff7b-40e8-8262-811fcb0aca61 req-5a1ea453-c17e-4e44-8051-0caf861ade48 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033679 Sep 06 01:13:09.030091 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 116/237] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:13:09.061347 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-b6785c82-e112-45b3-908d-a9a334596b12 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Flavor limits 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 01:13:09.061861 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-b6785c82-e112-45b3-908d-a9a334596b12 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Image limits 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 01:13:09.062398 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-b6785c82-e112-45b3-908d-a9a334596b12 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Flavor pref 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 01:13:09.062875 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-b6785c82-e112-45b3-908d-a9a334596b12 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Image pref 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 01:13:09.063353 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-b6785c82-e112-45b3-908d-a9a334596b12 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 01:13:09.074281 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b6785c82-e112-45b3-908d-a9a334596b12 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:09.074692 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b6785c82-e112-45b3-908d-a9a334596b12 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:09.075280 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b6785c82-e112-45b3-908d-a9a334596b12 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:09.076098 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b6785c82-e112-45b3-908d-a9a334596b12 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:09.076615 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b6785c82-e112-45b3-908d-a9a334596b12 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:09.077109 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b6785c82-e112-45b3-908d-a9a334596b12 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:09.095991 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.quota [None req-b6785c82-e112-45b3-908d-a9a334596b12 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Getting quotas for project 9ead4033c51d4658a5406c045da1c26e. Resources: {'instances', 'ram', 'cores'} {{(pid=120580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 01:13:09.100463 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.quota [None req-b6785c82-e112-45b3-908d-a9a334596b12 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Getting quotas for user 453fa4c58743419bb29e5f01d9f78041 and project 9ead4033c51d4658a5406c045da1c26e. Resources: {'instances', 'ram', 'cores'} {{(pid=120580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 01:13:09.113619 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-b6785c82-e112-45b3-908d-a9a334596b12 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Going to run 1 instances... {{(pid=120580) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 01:13:09.116473 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-b6785c82-e112-45b3-908d-a9a334596b12 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: ca3a12a4-8200-4090-b6ea-b41f0fdd46a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='768973cc-7b5f-4eed-b493-e40eb0de9f88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 01:13:09.165070 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-b6785c82-e112-45b3-908d-a9a334596b12 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.785022 Sep 06 01:13:09.165880 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 122/238] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Sep 6 01:13:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 01:13:09.177782 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d8aad0fe-7a55-4c19-b926-5e77fcf3bbc4 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:09.179305 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d8aad0fe-7a55-4c19-b926-5e77fcf3bbc4 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: ca3a12a4-8200-4090-b6ea-b41f0fdd46a6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:09.274584 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-d8aad0fe-7a55-4c19-b926-5e77fcf3bbc4 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:09.282315 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d8aad0fe-7a55-4c19-b926-5e77fcf3bbc4 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6" status: 200 len: 1213 microversion: 2.1 time: 0.108712 Sep 06 01:13:09.282881 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 117/239] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:09 2022] GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 => generated 1213 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:10.018950 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-c3a6d8b7-9797-41a6-b21d-3af2a488a0ab tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:10.019589 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-c3a6d8b7-9797-41a6-b21d-3af2a488a0ab tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:10.026341 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c3a6d8b7-9797-41a6-b21d-3af2a488a0ab tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:10.026642 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c3a6d8b7-9797-41a6-b21d-3af2a488a0ab tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:10.027069 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c3a6d8b7-9797-41a6-b21d-3af2a488a0ab tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:10.027813 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c3a6d8b7-9797-41a6-b21d-3af2a488a0ab tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:10.028264 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c3a6d8b7-9797-41a6-b21d-3af2a488a0ab tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:10.028683 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c3a6d8b7-9797-41a6-b21d-3af2a488a0ab tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:10.178185 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-c3a6d8b7-9797-41a6-b21d-3af2a488a0ab tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:10.192271 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-c3a6d8b7-9797-41a6-b21d-3af2a488a0ab tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1522 microversion: 2.1 time: 0.177595 Sep 06 01:13:10.193267 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 123/240] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:10 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:10.305956 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b84b5002-60e8-45ca-a0c5-ad59728442d7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:10.306545 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b84b5002-60e8-45ca-a0c5-ad59728442d7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: ca3a12a4-8200-4090-b6ea-b41f0fdd46a6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:10.314492 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b84b5002-60e8-45ca-a0c5-ad59728442d7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:10.315334 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b84b5002-60e8-45ca-a0c5-ad59728442d7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:10.316032 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b84b5002-60e8-45ca-a0c5-ad59728442d7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:10.317216 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b84b5002-60e8-45ca-a0c5-ad59728442d7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:10.317922 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b84b5002-60e8-45ca-a0c5-ad59728442d7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:10.318801 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b84b5002-60e8-45ca-a0c5-ad59728442d7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:10.400987 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-b84b5002-60e8-45ca-a0c5-ad59728442d7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:10.409200 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b84b5002-60e8-45ca-a0c5-ad59728442d7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6" status: 200 len: 1265 microversion: 2.1 time: 0.107105 Sep 06 01:13:10.409763 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 118/241] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:10 2022] GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 => generated 1265 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:11.215227 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-0b586e53-5572-4ced-8558-036ae58af10b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:11.215888 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-0b586e53-5572-4ced-8558-036ae58af10b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:11.221776 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0b586e53-5572-4ced-8558-036ae58af10b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:11.222284 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0b586e53-5572-4ced-8558-036ae58af10b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:11.222714 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0b586e53-5572-4ced-8558-036ae58af10b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:11.223395 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0b586e53-5572-4ced-8558-036ae58af10b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:11.223864 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0b586e53-5572-4ced-8558-036ae58af10b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:11.224812 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0b586e53-5572-4ced-8558-036ae58af10b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:11.357783 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-0b586e53-5572-4ced-8558-036ae58af10b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:11.365538 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-0b586e53-5572-4ced-8558-036ae58af10b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1522 microversion: 2.1 time: 0.154128 Sep 06 01:13:11.366098 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 124/242] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:11 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:11.433151 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c11b49ab-9f76-49c1-a7b4-efa102c7bde7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:11.433784 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c11b49ab-9f76-49c1-a7b4-efa102c7bde7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: ca3a12a4-8200-4090-b6ea-b41f0fdd46a6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:11.440135 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c11b49ab-9f76-49c1-a7b4-efa102c7bde7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:11.440605 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c11b49ab-9f76-49c1-a7b4-efa102c7bde7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:11.441051 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c11b49ab-9f76-49c1-a7b4-efa102c7bde7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:11.441727 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c11b49ab-9f76-49c1-a7b4-efa102c7bde7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:11.442174 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c11b49ab-9f76-49c1-a7b4-efa102c7bde7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:11.442590 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c11b49ab-9f76-49c1-a7b4-efa102c7bde7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:11.508552 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-c11b49ab-9f76-49c1-a7b4-efa102c7bde7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:11.519743 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c11b49ab-9f76-49c1-a7b4-efa102c7bde7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6" status: 200 len: 1265 microversion: 2.1 time: 0.090457 Sep 06 01:13:11.520649 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 119/243] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:11 2022] GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 => generated 1265 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:12.388694 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-93c890cc-d69b-45c6-9c01-e1d7657b3dae tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:12.389425 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-93c890cc-d69b-45c6-9c01-e1d7657b3dae tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:12.395731 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-93c890cc-d69b-45c6-9c01-e1d7657b3dae tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:12.400443 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-93c890cc-d69b-45c6-9c01-e1d7657b3dae tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:12.400911 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-93c890cc-d69b-45c6-9c01-e1d7657b3dae tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:12.401677 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-93c890cc-d69b-45c6-9c01-e1d7657b3dae tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:12.402132 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-93c890cc-d69b-45c6-9c01-e1d7657b3dae tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:12.402559 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-93c890cc-d69b-45c6-9c01-e1d7657b3dae tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:12.532158 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-93c890cc-d69b-45c6-9c01-e1d7657b3dae tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:12.542931 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-93c890cc-d69b-45c6-9c01-e1d7657b3dae tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1502 microversion: 2.1 time: 0.158056 Sep 06 01:13:12.544370 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 125/244] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:12 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1502 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:12.553891 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fc66b010-1f3b-4afd-9f8f-b2f26df0158f tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:12.554741 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fc66b010-1f3b-4afd-9f8f-b2f26df0158f tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: ca3a12a4-8200-4090-b6ea-b41f0fdd46a6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:12.564701 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc66b010-1f3b-4afd-9f8f-b2f26df0158f tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:12.565448 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc66b010-1f3b-4afd-9f8f-b2f26df0158f tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:12.565887 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc66b010-1f3b-4afd-9f8f-b2f26df0158f tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:12.566590 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc66b010-1f3b-4afd-9f8f-b2f26df0158f tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:12.566766 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-253ed82f-3a09-49c3-85fd-6f078b53e05e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:12.567259 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc66b010-1f3b-4afd-9f8f-b2f26df0158f tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:12.567694 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc66b010-1f3b-4afd-9f8f-b2f26df0158f tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:12.567885 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-253ed82f-3a09-49c3-85fd-6f078b53e05e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:12.573903 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-253ed82f-3a09-49c3-85fd-6f078b53e05e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:12.574676 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-253ed82f-3a09-49c3-85fd-6f078b53e05e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:12.575371 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-253ed82f-3a09-49c3-85fd-6f078b53e05e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:12.576313 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-253ed82f-3a09-49c3-85fd-6f078b53e05e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:12.576977 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-253ed82f-3a09-49c3-85fd-6f078b53e05e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:12.577616 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-253ed82f-3a09-49c3-85fd-6f078b53e05e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:12.645705 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-fc66b010-1f3b-4afd-9f8f-b2f26df0158f tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:12.654370 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fc66b010-1f3b-4afd-9f8f-b2f26df0158f tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6" status: 200 len: 1271 microversion: 2.1 time: 0.114357 Sep 06 01:13:12.668077 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 120/245] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:12 2022] GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 => generated 1271 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:13:12.732816 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-253ed82f-3a09-49c3-85fd-6f078b53e05e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:12.740604 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-253ed82f-3a09-49c3-85fd-6f078b53e05e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1514 microversion: 2.1 time: 0.177706 Sep 06 01:13:12.741265 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 126/246] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:12 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1514 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:13.652682 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-783f8f8f-5d81-46d5-933a-b70af7d0908a req-6eb66462-7fb2-4a34-bb71-6302af577cbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca3a12a4-8200-4090-b6ea-b41f0fdd46a6", "tag": "08782fbc-65be-42e4-9894-f8d8247f12e9"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:13:13.672081 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-783f8f8f-5d81-46d5-933a-b70af7d0908a req-6eb66462-7fb2-4a34-bb71-6302af577cbe service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:13.672581 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-783f8f8f-5d81-46d5-933a-b70af7d0908a req-6eb66462-7fb2-4a34-bb71-6302af577cbe service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:13.673839 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-783f8f8f-5d81-46d5-933a-b70af7d0908a req-6eb66462-7fb2-4a34-bb71-6302af577cbe service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:13.685547 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-ae64cb6b-3b44-4be4-a39e-38f07b77ed9b tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:13.688967 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-ae64cb6b-3b44-4be4-a39e-38f07b77ed9b tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: ca3a12a4-8200-4090-b6ea-b41f0fdd46a6] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:13.689556 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-783f8f8f-5d81-46d5-933a-b70af7d0908a req-6eb66462-7fb2-4a34-bb71-6302af577cbe service nova] Creating event network-changed:08782fbc-65be-42e4-9894-f8d8247f12e9 for instance ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 on hv-cinder-84773 Sep 06 01:13:13.695530 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-783f8f8f-5d81-46d5-933a-b70af7d0908a req-6eb66462-7fb2-4a34-bb71-6302af577cbe service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049438 Sep 06 01:13:13.697863 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 121/247] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 01:13:13.702264 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ae64cb6b-3b44-4be4-a39e-38f07b77ed9b tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:13.702754 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ae64cb6b-3b44-4be4-a39e-38f07b77ed9b tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:13.703186 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ae64cb6b-3b44-4be4-a39e-38f07b77ed9b tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:13.704800 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ae64cb6b-3b44-4be4-a39e-38f07b77ed9b tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:13.705470 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ae64cb6b-3b44-4be4-a39e-38f07b77ed9b tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:13.705938 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ae64cb6b-3b44-4be4-a39e-38f07b77ed9b tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:13.840413 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-ae64cb6b-3b44-4be4-a39e-38f07b77ed9b tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:13.848103 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-ae64cb6b-3b44-4be4-a39e-38f07b77ed9b tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6" status: 200 len: 1313 microversion: 2.1 time: 0.173188 Sep 06 01:13:13.848670 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 127/248] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:13 2022] GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:14.186367 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-05187c79-a1d4-46bc-8dd9-4eb645244cf9 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:13:14.188723 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-05187c79-a1d4-46bc-8dd9-4eb645244cf9 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:14.195540 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05187c79-a1d4-46bc-8dd9-4eb645244cf9 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:14.196048 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05187c79-a1d4-46bc-8dd9-4eb645244cf9 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:14.196478 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05187c79-a1d4-46bc-8dd9-4eb645244cf9 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:14.197290 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05187c79-a1d4-46bc-8dd9-4eb645244cf9 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:14.197721 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05187c79-a1d4-46bc-8dd9-4eb645244cf9 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:14.198142 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05187c79-a1d4-46bc-8dd9-4eb645244cf9 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:14.225584 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-05187c79-a1d4-46bc-8dd9-4eb645244cf9 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lazy-loading 'flavor' on Instance uuid cf424d2a-0a95-48dc-9ee5-13fab569cb43 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 01:13:14.302583 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-05187c79-a1d4-46bc-8dd9-4eb645244cf9 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "POST /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43/action" status: 200 len: 32 microversion: 2.1 time: 0.120365 Sep 06 01:13:14.303262 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 122/249] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Sep 6 01:13:14 2022] POST /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43/action => generated 32 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 01:13:14.318270 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-c05367dd-4ba7-4bec-8f44-c05a4f98e6e5 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:14.319265 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-c05367dd-4ba7-4bec-8f44-c05a4f98e6e5 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:14.331704 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c05367dd-4ba7-4bec-8f44-c05a4f98e6e5 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:14.332453 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c05367dd-4ba7-4bec-8f44-c05a4f98e6e5 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:14.332903 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c05367dd-4ba7-4bec-8f44-c05a4f98e6e5 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:14.334154 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c05367dd-4ba7-4bec-8f44-c05a4f98e6e5 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:14.334632 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c05367dd-4ba7-4bec-8f44-c05a4f98e6e5 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:14.335057 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c05367dd-4ba7-4bec-8f44-c05a4f98e6e5 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:14.566807 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-c05367dd-4ba7-4bec-8f44-c05a4f98e6e5 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:14.576138 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-c05367dd-4ba7-4bec-8f44-c05a4f98e6e5 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1520 microversion: 2.1 time: 0.266864 Sep 06 01:13:14.592313 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 128/250] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:14 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1520 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:14.872083 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a716a77f-a3d9-47e1-b43f-8d22f91dcfc0 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:14.872788 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a716a77f-a3d9-47e1-b43f-8d22f91dcfc0 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: ca3a12a4-8200-4090-b6ea-b41f0fdd46a6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:14.878879 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a716a77f-a3d9-47e1-b43f-8d22f91dcfc0 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:14.879366 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a716a77f-a3d9-47e1-b43f-8d22f91dcfc0 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:14.879828 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a716a77f-a3d9-47e1-b43f-8d22f91dcfc0 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:14.881104 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a716a77f-a3d9-47e1-b43f-8d22f91dcfc0 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:14.881545 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a716a77f-a3d9-47e1-b43f-8d22f91dcfc0 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:14.881975 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a716a77f-a3d9-47e1-b43f-8d22f91dcfc0 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:15.047211 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-a716a77f-a3d9-47e1-b43f-8d22f91dcfc0 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:15.055549 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a716a77f-a3d9-47e1-b43f-8d22f91dcfc0 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6" status: 200 len: 1313 microversion: 2.1 time: 0.188362 Sep 06 01:13:15.056136 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 123/251] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:14 2022] GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:15.599849 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-2f522f0c-6e69-44ad-abdb-d26b2a6fe115 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:15.600591 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-2f522f0c-6e69-44ad-abdb-d26b2a6fe115 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:15.608220 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2f522f0c-6e69-44ad-abdb-d26b2a6fe115 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:15.608930 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2f522f0c-6e69-44ad-abdb-d26b2a6fe115 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:15.609567 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2f522f0c-6e69-44ad-abdb-d26b2a6fe115 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:15.610688 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2f522f0c-6e69-44ad-abdb-d26b2a6fe115 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:15.611386 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2f522f0c-6e69-44ad-abdb-d26b2a6fe115 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:15.612026 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2f522f0c-6e69-44ad-abdb-d26b2a6fe115 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:15.747612 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-2f522f0c-6e69-44ad-abdb-d26b2a6fe115 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:15.755714 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-2f522f0c-6e69-44ad-abdb-d26b2a6fe115 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1520 microversion: 2.1 time: 0.160545 Sep 06 01:13:15.756297 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 129/252] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:15 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:16.078189 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ea2ee0e4-f7ff-4c8c-b4ed-3ac5526794b3 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:16.078696 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ea2ee0e4-f7ff-4c8c-b4ed-3ac5526794b3 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: ca3a12a4-8200-4090-b6ea-b41f0fdd46a6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:16.085115 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea2ee0e4-f7ff-4c8c-b4ed-3ac5526794b3 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:16.085595 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea2ee0e4-f7ff-4c8c-b4ed-3ac5526794b3 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:16.086021 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea2ee0e4-f7ff-4c8c-b4ed-3ac5526794b3 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:16.086696 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea2ee0e4-f7ff-4c8c-b4ed-3ac5526794b3 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:16.087143 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea2ee0e4-f7ff-4c8c-b4ed-3ac5526794b3 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:16.087558 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea2ee0e4-f7ff-4c8c-b4ed-3ac5526794b3 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:16.216396 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-ea2ee0e4-f7ff-4c8c-b4ed-3ac5526794b3 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:16.224041 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ea2ee0e4-f7ff-4c8c-b4ed-3ac5526794b3 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6" status: 200 len: 1313 microversion: 2.1 time: 0.149763 Sep 06 01:13:16.224605 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 124/253] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:16 2022] GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:16.780208 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-c577b291-05fa-4704-bc18-f93d5e9ee29a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:16.780750 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-c577b291-05fa-4704-bc18-f93d5e9ee29a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:16.787280 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c577b291-05fa-4704-bc18-f93d5e9ee29a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:16.787775 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c577b291-05fa-4704-bc18-f93d5e9ee29a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:16.788222 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c577b291-05fa-4704-bc18-f93d5e9ee29a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:16.788945 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c577b291-05fa-4704-bc18-f93d5e9ee29a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:16.789394 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c577b291-05fa-4704-bc18-f93d5e9ee29a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:16.789816 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c577b291-05fa-4704-bc18-f93d5e9ee29a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:16.920998 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-c577b291-05fa-4704-bc18-f93d5e9ee29a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:16.928574 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-c577b291-05fa-4704-bc18-f93d5e9ee29a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1520 microversion: 2.1 time: 0.152441 Sep 06 01:13:16.929135 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 130/254] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:16 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:13:17.246266 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f6913532-0d59-43a5-88fe-3469a4040ebe tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:17.246962 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f6913532-0d59-43a5-88fe-3469a4040ebe tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: ca3a12a4-8200-4090-b6ea-b41f0fdd46a6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:17.253828 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f6913532-0d59-43a5-88fe-3469a4040ebe tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:17.254316 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f6913532-0d59-43a5-88fe-3469a4040ebe tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:17.254750 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f6913532-0d59-43a5-88fe-3469a4040ebe tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:17.255967 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f6913532-0d59-43a5-88fe-3469a4040ebe tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:17.256423 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f6913532-0d59-43a5-88fe-3469a4040ebe tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:17.256849 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f6913532-0d59-43a5-88fe-3469a4040ebe tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:17.388717 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-f6913532-0d59-43a5-88fe-3469a4040ebe tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:17.392447 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:17.397917 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f6913532-0d59-43a5-88fe-3469a4040ebe tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6" status: 200 len: 1313 microversion: 2.1 time: 0.155513 Sep 06 01:13:17.398478 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 125/255] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:17 2022] GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:17.951151 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-15b14d33-b9c9-4362-8ec0-26b085399f22 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:17.951770 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-15b14d33-b9c9-4362-8ec0-26b085399f22 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:17.957852 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-15b14d33-b9c9-4362-8ec0-26b085399f22 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:17.958329 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-15b14d33-b9c9-4362-8ec0-26b085399f22 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:17.958809 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-15b14d33-b9c9-4362-8ec0-26b085399f22 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:17.959486 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-15b14d33-b9c9-4362-8ec0-26b085399f22 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:17.959965 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-15b14d33-b9c9-4362-8ec0-26b085399f22 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:17.960383 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-15b14d33-b9c9-4362-8ec0-26b085399f22 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:17.964229 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell1:SELECT=100 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:18.095323 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-15b14d33-b9c9-4362-8ec0-26b085399f22 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:18.103520 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-15b14d33-b9c9-4362-8ec0-26b085399f22 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1520 microversion: 2.1 time: 0.156220 Sep 06 01:13:18.104093 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 131/256] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:17 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:18.420607 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-18ae32e1-b7d0-4716-a5ed-b06c55ad33a9 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:18.421258 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-18ae32e1-b7d0-4716-a5ed-b06c55ad33a9 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: ca3a12a4-8200-4090-b6ea-b41f0fdd46a6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:18.428761 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18ae32e1-b7d0-4716-a5ed-b06c55ad33a9 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:18.429240 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18ae32e1-b7d0-4716-a5ed-b06c55ad33a9 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:18.429683 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18ae32e1-b7d0-4716-a5ed-b06c55ad33a9 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:18.430378 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18ae32e1-b7d0-4716-a5ed-b06c55ad33a9 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:18.430833 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18ae32e1-b7d0-4716-a5ed-b06c55ad33a9 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:18.431252 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18ae32e1-b7d0-4716-a5ed-b06c55ad33a9 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:18.566680 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-18ae32e1-b7d0-4716-a5ed-b06c55ad33a9 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:18.574329 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-18ae32e1-b7d0-4716-a5ed-b06c55ad33a9 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6" status: 200 len: 1313 microversion: 2.1 time: 0.158359 Sep 06 01:13:18.586261 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 126/257] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:18 2022] GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:19.127183 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-43e07913-23b1-4e26-9b7d-c2e205f691de tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:19.127838 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-43e07913-23b1-4e26-9b7d-c2e205f691de tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:19.129953 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell0:SELECT=2 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:19.131158 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell0:SELECT=6 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:19.137202 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-43e07913-23b1-4e26-9b7d-c2e205f691de tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:19.137679 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-43e07913-23b1-4e26-9b7d-c2e205f691de tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:19.138115 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-43e07913-23b1-4e26-9b7d-c2e205f691de tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:19.138795 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-43e07913-23b1-4e26-9b7d-c2e205f691de tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:19.139244 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-43e07913-23b1-4e26-9b7d-c2e205f691de tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:19.139664 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-43e07913-23b1-4e26-9b7d-c2e205f691de tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:19.270643 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-43e07913-23b1-4e26-9b7d-c2e205f691de tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:19.278751 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-43e07913-23b1-4e26-9b7d-c2e205f691de tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1520 microversion: 2.1 time: 0.155325 Sep 06 01:13:19.279329 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 132/258] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:19 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:19.597456 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bcf95f17-3d33-4ad2-946c-c68aee500455 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:19.598062 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bcf95f17-3d33-4ad2-946c-c68aee500455 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: ca3a12a4-8200-4090-b6ea-b41f0fdd46a6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:19.600488 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:19.606540 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bcf95f17-3d33-4ad2-946c-c68aee500455 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:19.607107 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bcf95f17-3d33-4ad2-946c-c68aee500455 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:19.607438 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bcf95f17-3d33-4ad2-946c-c68aee500455 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:19.608165 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bcf95f17-3d33-4ad2-946c-c68aee500455 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:19.608636 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bcf95f17-3d33-4ad2-946c-c68aee500455 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:19.609199 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bcf95f17-3d33-4ad2-946c-c68aee500455 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:19.750434 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-bcf95f17-3d33-4ad2-946c-c68aee500455 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:19.758949 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bcf95f17-3d33-4ad2-946c-c68aee500455 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6" status: 200 len: 1313 microversion: 2.1 time: 0.165154 Sep 06 01:13:19.759810 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 127/259] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:19 2022] GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:20.301831 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-fcfc829f-e860-4f97-8bc8-75202df382a0 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:20.302199 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-fcfc829f-e860-4f97-8bc8-75202df382a0 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:20.308331 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fcfc829f-e860-4f97-8bc8-75202df382a0 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:20.308814 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fcfc829f-e860-4f97-8bc8-75202df382a0 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:20.309246 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fcfc829f-e860-4f97-8bc8-75202df382a0 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:20.309939 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fcfc829f-e860-4f97-8bc8-75202df382a0 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:20.310390 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fcfc829f-e860-4f97-8bc8-75202df382a0 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:20.310813 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fcfc829f-e860-4f97-8bc8-75202df382a0 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:20.438201 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-fcfc829f-e860-4f97-8bc8-75202df382a0 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:20.446414 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-fcfc829f-e860-4f97-8bc8-75202df382a0 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1520 microversion: 2.1 time: 0.149133 Sep 06 01:13:20.446994 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 133/260] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:20 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:20.782036 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2a5b05e7-950f-4ce8-9aa2-c1849e73ab74 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:20.782642 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2a5b05e7-950f-4ce8-9aa2-c1849e73ab74 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: ca3a12a4-8200-4090-b6ea-b41f0fdd46a6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:20.786575 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-ed1b247b-74f6-424d-9e26-13dd72e70e5d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:20.786765 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-ed1b247b-74f6-424d-9e26-13dd72e70e5d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:20.789621 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a5b05e7-950f-4ce8-9aa2-c1849e73ab74 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:20.790106 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a5b05e7-950f-4ce8-9aa2-c1849e73ab74 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:20.790533 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a5b05e7-950f-4ce8-9aa2-c1849e73ab74 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:20.791223 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a5b05e7-950f-4ce8-9aa2-c1849e73ab74 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:20.791671 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a5b05e7-950f-4ce8-9aa2-c1849e73ab74 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:20.792109 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a5b05e7-950f-4ce8-9aa2-c1849e73ab74 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:20.792777 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ed1b247b-74f6-424d-9e26-13dd72e70e5d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:20.793519 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ed1b247b-74f6-424d-9e26-13dd72e70e5d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:20.793957 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ed1b247b-74f6-424d-9e26-13dd72e70e5d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:20.794661 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ed1b247b-74f6-424d-9e26-13dd72e70e5d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:20.795169 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ed1b247b-74f6-424d-9e26-13dd72e70e5d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:20.795598 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ed1b247b-74f6-424d-9e26-13dd72e70e5d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:20.820176 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-ed1b247b-74f6-424d-9e26-13dd72e70e5d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e/ips" status: 200 len: 151 microversion: 2.1 time: 0.038462 Sep 06 01:13:20.820749 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 134/261] 10.222.0.23 () {58 vars in 1248 bytes} [Tue Sep 6 01:13:20 2022] GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:13:20.927913 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-2a5b05e7-950f-4ce8-9aa2-c1849e73ab74 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:20.935524 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2a5b05e7-950f-4ce8-9aa2-c1849e73ab74 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6" status: 200 len: 1313 microversion: 2.1 time: 0.157503 Sep 06 01:13:20.936173 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 128/262] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:20 2022] GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:21.470454 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-41b692e3-124f-4221-bfcf-9f4e28148a2d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:21.471071 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-41b692e3-124f-4221-bfcf-9f4e28148a2d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:21.477583 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-41b692e3-124f-4221-bfcf-9f4e28148a2d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:21.478066 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-41b692e3-124f-4221-bfcf-9f4e28148a2d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:21.478502 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-41b692e3-124f-4221-bfcf-9f4e28148a2d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:21.479190 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-41b692e3-124f-4221-bfcf-9f4e28148a2d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:21.479640 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-41b692e3-124f-4221-bfcf-9f4e28148a2d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:21.480090 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-41b692e3-124f-4221-bfcf-9f4e28148a2d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:21.616934 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-41b692e3-124f-4221-bfcf-9f4e28148a2d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:21.624226 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-41b692e3-124f-4221-bfcf-9f4e28148a2d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1520 microversion: 2.1 time: 0.158029 Sep 06 01:13:21.624785 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 135/263] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:21 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:21.961469 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-596cd21e-cbd1-43b6-81f1-9ac5b95b3c6f tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:21.962090 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-596cd21e-cbd1-43b6-81f1-9ac5b95b3c6f tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: ca3a12a4-8200-4090-b6ea-b41f0fdd46a6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:21.969551 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-596cd21e-cbd1-43b6-81f1-9ac5b95b3c6f tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:21.969964 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-596cd21e-cbd1-43b6-81f1-9ac5b95b3c6f tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:21.970504 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-596cd21e-cbd1-43b6-81f1-9ac5b95b3c6f tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:21.971284 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-596cd21e-cbd1-43b6-81f1-9ac5b95b3c6f tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:21.971743 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-596cd21e-cbd1-43b6-81f1-9ac5b95b3c6f tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:21.972315 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-596cd21e-cbd1-43b6-81f1-9ac5b95b3c6f tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:22.010331 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-61ec53ba-7878-4995-bb0c-94221c4d79b8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:22.010924 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-61ec53ba-7878-4995-bb0c-94221c4d79b8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:22.016810 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-61ec53ba-7878-4995-bb0c-94221c4d79b8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:22.017356 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-61ec53ba-7878-4995-bb0c-94221c4d79b8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:22.017851 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-61ec53ba-7878-4995-bb0c-94221c4d79b8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:22.018598 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-61ec53ba-7878-4995-bb0c-94221c4d79b8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:22.019114 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-61ec53ba-7878-4995-bb0c-94221c4d79b8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:22.019597 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-61ec53ba-7878-4995-bb0c-94221c4d79b8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:22.045382 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-61ec53ba-7878-4995-bb0c-94221c4d79b8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125/ips" status: 200 len: 151 microversion: 2.20 time: 0.038817 Sep 06 01:13:22.045952 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 136/264] 10.222.0.23 () {60 vars in 1289 bytes} [Tue Sep 6 01:13:22 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 01:13:22.104632 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-596cd21e-cbd1-43b6-81f1-9ac5b95b3c6f tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:22.114226 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-596cd21e-cbd1-43b6-81f1-9ac5b95b3c6f tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6" status: 200 len: 1313 microversion: 2.1 time: 0.156967 Sep 06 01:13:22.115275 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 129/265] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:21 2022] GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:22.210526 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-f7a8df93-f943-4c3a-91e6-49ce29d8325b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ac6fa67-d970-433d-be24-0bc4bed540dc"}} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:13:22.213014 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-f7a8df93-f943-4c3a-91e6-49ce29d8325b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:22.219703 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f7a8df93-f943-4c3a-91e6-49ce29d8325b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:22.220171 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f7a8df93-f943-4c3a-91e6-49ce29d8325b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:22.220606 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f7a8df93-f943-4c3a-91e6-49ce29d8325b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:22.221301 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f7a8df93-f943-4c3a-91e6-49ce29d8325b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:22.221752 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f7a8df93-f943-4c3a-91e6-49ce29d8325b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:22.222226 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f7a8df93-f943-4c3a-91e6-49ce29d8325b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:22.646890 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c76ceb31-5532-4c7a-a5a0-707d7cb0abbf tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:22.647564 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c76ceb31-5532-4c7a-a5a0-707d7cb0abbf tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:22.654729 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c76ceb31-5532-4c7a-a5a0-707d7cb0abbf tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:22.655208 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c76ceb31-5532-4c7a-a5a0-707d7cb0abbf tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:22.656272 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c76ceb31-5532-4c7a-a5a0-707d7cb0abbf tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:22.656980 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c76ceb31-5532-4c7a-a5a0-707d7cb0abbf tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:22.657439 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c76ceb31-5532-4c7a-a5a0-707d7cb0abbf tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:22.657685 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-f7a8df93-f943-4c3a-91e6-49ce29d8325b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "POST /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.451376 Sep 06 01:13:22.658132 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c76ceb31-5532-4c7a-a5a0-707d7cb0abbf tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:22.658593 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 137/266] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Sep 6 01:13:22 2022] POST /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e/os-volume_attachments => generated 194 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 01:13:22.802709 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-c76ceb31-5532-4c7a-a5a0-707d7cb0abbf tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:22.811014 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c76ceb31-5532-4c7a-a5a0-707d7cb0abbf tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1520 microversion: 2.1 time: 0.167981 Sep 06 01:13:22.811642 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 130/267] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:22 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:13:23.139866 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-d7d71c88-9726-4a68-a753-dafee9fe51d3 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:23.140485 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-d7d71c88-9726-4a68-a753-dafee9fe51d3 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: ca3a12a4-8200-4090-b6ea-b41f0fdd46a6] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:23.147320 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d7d71c88-9726-4a68-a753-dafee9fe51d3 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:23.147812 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d7d71c88-9726-4a68-a753-dafee9fe51d3 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:23.148247 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d7d71c88-9726-4a68-a753-dafee9fe51d3 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:23.148946 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d7d71c88-9726-4a68-a753-dafee9fe51d3 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:23.149383 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d7d71c88-9726-4a68-a753-dafee9fe51d3 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:23.149804 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d7d71c88-9726-4a68-a753-dafee9fe51d3 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:23.277272 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-d7d71c88-9726-4a68-a753-dafee9fe51d3 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:23.285734 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-d7d71c88-9726-4a68-a753-dafee9fe51d3 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6" status: 200 len: 1313 microversion: 2.1 time: 0.150975 Sep 06 01:13:23.286306 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 138/268] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:23 2022] GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:23.833972 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4776a0ab-8d44-4e10-afa1-360fdbd51a51 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:23.834581 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4776a0ab-8d44-4e10-afa1-360fdbd51a51 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:23.841168 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4776a0ab-8d44-4e10-afa1-360fdbd51a51 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:23.841780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4776a0ab-8d44-4e10-afa1-360fdbd51a51 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:23.842221 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4776a0ab-8d44-4e10-afa1-360fdbd51a51 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:23.842908 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4776a0ab-8d44-4e10-afa1-360fdbd51a51 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:23.843474 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4776a0ab-8d44-4e10-afa1-360fdbd51a51 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:23.843928 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4776a0ab-8d44-4e10-afa1-360fdbd51a51 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:23.977988 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-4776a0ab-8d44-4e10-afa1-360fdbd51a51 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:23.985474 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4776a0ab-8d44-4e10-afa1-360fdbd51a51 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1520 microversion: 2.1 time: 0.155377 Sep 06 01:13:23.986033 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 131/269] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:23 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:24.308870 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-a6e78788-170f-45a3-a5f9-bc2947ee9842 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:24.309526 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-a6e78788-170f-45a3-a5f9-bc2947ee9842 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: ca3a12a4-8200-4090-b6ea-b41f0fdd46a6] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:24.315897 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a6e78788-170f-45a3-a5f9-bc2947ee9842 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:24.316377 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a6e78788-170f-45a3-a5f9-bc2947ee9842 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:24.316804 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a6e78788-170f-45a3-a5f9-bc2947ee9842 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:24.317482 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a6e78788-170f-45a3-a5f9-bc2947ee9842 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:24.317927 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a6e78788-170f-45a3-a5f9-bc2947ee9842 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:24.318383 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a6e78788-170f-45a3-a5f9-bc2947ee9842 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:24.636758 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-a6e78788-170f-45a3-a5f9-bc2947ee9842 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:24.644410 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-a6e78788-170f-45a3-a5f9-bc2947ee9842 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6" status: 200 len: 1313 microversion: 2.1 time: 0.339454 Sep 06 01:13:24.644958 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 139/270] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:24 2022] GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 => generated 1313 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:24.730526 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9e2860c2-e772-47ea-85cc-a71fbe0461b3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:13:24.731067 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9e2860c2-e772-47ea-85cc-a71fbe0461b3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:24.736965 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e2860c2-e772-47ea-85cc-a71fbe0461b3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:24.737444 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e2860c2-e772-47ea-85cc-a71fbe0461b3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:24.737875 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e2860c2-e772-47ea-85cc-a71fbe0461b3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:24.738558 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e2860c2-e772-47ea-85cc-a71fbe0461b3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:24.739010 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e2860c2-e772-47ea-85cc-a71fbe0461b3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:24.739430 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e2860c2-e772-47ea-85cc-a71fbe0461b3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:24.762302 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-9e2860c2-e772-47ea-85cc-a71fbe0461b3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lazy-loading 'flavor' on Instance uuid c42df4ca-a678-4b12-b5dc-3f3c0af93125 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 01:13:24.964694 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9e2860c2-e772-47ea-85cc-a71fbe0461b3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "POST /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125/action" status: 202 len: 0 microversion: 2.20 time: 0.237824 Sep 06 01:13:24.965328 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 132/271] 10.222.0.23 () {62 vars in 1319 bytes} [Tue Sep 6 01:13:24 2022] POST /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 06 01:13:24.974613 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-7db14b26-6c0f-4619-9409-7abe0701960e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:24.975219 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-7db14b26-6c0f-4619-9409-7abe0701960e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:24.982068 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7db14b26-6c0f-4619-9409-7abe0701960e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:24.982806 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7db14b26-6c0f-4619-9409-7abe0701960e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:24.983399 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7db14b26-6c0f-4619-9409-7abe0701960e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:24.984332 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7db14b26-6c0f-4619-9409-7abe0701960e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:24.984850 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7db14b26-6c0f-4619-9409-7abe0701960e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:24.985351 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7db14b26-6c0f-4619-9409-7abe0701960e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:25.013450 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-848265a4-d452-437c-ba10-630449ef88ef tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:25.014149 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-848265a4-d452-437c-ba10-630449ef88ef tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:25.023921 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-848265a4-d452-437c-ba10-630449ef88ef tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:25.024411 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-848265a4-d452-437c-ba10-630449ef88ef tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:25.024853 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-848265a4-d452-437c-ba10-630449ef88ef tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:25.025566 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-848265a4-d452-437c-ba10-630449ef88ef tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:25.026003 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-848265a4-d452-437c-ba10-630449ef88ef tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:25.026457 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-848265a4-d452-437c-ba10-630449ef88ef tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:25.174821 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-7db14b26-6c0f-4619-9409-7abe0701960e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:25.183520 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-7db14b26-6c0f-4619-9409-7abe0701960e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:25.184982 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-7db14b26-6c0f-4619-9409-7abe0701960e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:25.186123 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-7db14b26-6c0f-4619-9409-7abe0701960e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1724 microversion: 2.20 time: 0.216476 Sep 06 01:13:25.186671 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 140/272] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:13:24 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:13:25.204012 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-848265a4-d452-437c-ba10-630449ef88ef tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:25.211571 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-848265a4-d452-437c-ba10-630449ef88ef tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1520 microversion: 2.1 time: 0.202528 Sep 06 01:13:25.212152 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 133/273] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:25 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:13:25.668403 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-d279a320-bf25-4295-b2a7-8080fad3ac7e tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:25.669021 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-d279a320-bf25-4295-b2a7-8080fad3ac7e tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: ca3a12a4-8200-4090-b6ea-b41f0fdd46a6] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:25.677951 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d279a320-bf25-4295-b2a7-8080fad3ac7e tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:25.678437 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d279a320-bf25-4295-b2a7-8080fad3ac7e tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:25.678926 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d279a320-bf25-4295-b2a7-8080fad3ac7e tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:25.680220 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d279a320-bf25-4295-b2a7-8080fad3ac7e tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:25.680701 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d279a320-bf25-4295-b2a7-8080fad3ac7e tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:25.681121 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d279a320-bf25-4295-b2a7-8080fad3ac7e tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:25.814111 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-d279a320-bf25-4295-b2a7-8080fad3ac7e tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:25.821919 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-d279a320-bf25-4295-b2a7-8080fad3ac7e tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6" status: 200 len: 1313 microversion: 2.1 time: 0.157482 Sep 06 01:13:25.822481 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 141/274] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:25 2022] GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:26.213088 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cf76f7a6-057d-466a-a264-8c344ec3b561 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:26.213763 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cf76f7a6-057d-466a-a264-8c344ec3b561 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:26.220223 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf76f7a6-057d-466a-a264-8c344ec3b561 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:26.220702 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf76f7a6-057d-466a-a264-8c344ec3b561 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:26.221173 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf76f7a6-057d-466a-a264-8c344ec3b561 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:26.221860 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf76f7a6-057d-466a-a264-8c344ec3b561 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:26.222311 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf76f7a6-057d-466a-a264-8c344ec3b561 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:26.222736 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf76f7a6-057d-466a-a264-8c344ec3b561 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:26.234088 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-5051cf5c-80ca-4977-9bcf-1e6364a6d1ad tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:26.234863 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-5051cf5c-80ca-4977-9bcf-1e6364a6d1ad tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:26.241646 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5051cf5c-80ca-4977-9bcf-1e6364a6d1ad tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:26.241646 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5051cf5c-80ca-4977-9bcf-1e6364a6d1ad tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:26.242039 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5051cf5c-80ca-4977-9bcf-1e6364a6d1ad tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:26.242690 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5051cf5c-80ca-4977-9bcf-1e6364a6d1ad tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:26.243136 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5051cf5c-80ca-4977-9bcf-1e6364a6d1ad tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:26.243561 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5051cf5c-80ca-4977-9bcf-1e6364a6d1ad tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:26.433580 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-cf76f7a6-057d-466a-a264-8c344ec3b561 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:26.443994 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-5051cf5c-80ca-4977-9bcf-1e6364a6d1ad tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:26.448734 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-cf76f7a6-057d-466a-a264-8c344ec3b561 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:26.450223 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-cf76f7a6-057d-466a-a264-8c344ec3b561 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:26.451437 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cf76f7a6-057d-466a-a264-8c344ec3b561 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1724 microversion: 2.20 time: 0.243030 Sep 06 01:13:26.452050 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 134/275] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:13:26 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:13:26.453506 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-5051cf5c-80ca-4977-9bcf-1e6364a6d1ad tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1520 microversion: 2.1 time: 0.223184 Sep 06 01:13:26.454051 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 142/276] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:26 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:13:26.844928 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-18e639b1-ec7d-46b0-9b23-8d3aa9505ae7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:26.845534 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-18e639b1-ec7d-46b0-9b23-8d3aa9505ae7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: ca3a12a4-8200-4090-b6ea-b41f0fdd46a6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:26.851388 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18e639b1-ec7d-46b0-9b23-8d3aa9505ae7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:26.851912 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18e639b1-ec7d-46b0-9b23-8d3aa9505ae7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:26.852349 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18e639b1-ec7d-46b0-9b23-8d3aa9505ae7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:26.853030 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18e639b1-ec7d-46b0-9b23-8d3aa9505ae7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:26.853482 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18e639b1-ec7d-46b0-9b23-8d3aa9505ae7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:26.853902 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18e639b1-ec7d-46b0-9b23-8d3aa9505ae7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:26.995633 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-18e639b1-ec7d-46b0-9b23-8d3aa9505ae7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:27.008905 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-18e639b1-ec7d-46b0-9b23-8d3aa9505ae7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6" status: 200 len: 1313 microversion: 2.1 time: 0.167756 Sep 06 01:13:27.009722 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 135/277] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:26 2022] GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:27.477802 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-2b690430-b403-43c0-b488-8d0794487ba1 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:27.478378 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-635f8bec-cf29-45ed-9747-bf80d5ef47fa tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:27.478773 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-2b690430-b403-43c0-b488-8d0794487ba1 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:27.478861 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-635f8bec-cf29-45ed-9747-bf80d5ef47fa tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:27.485122 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-635f8bec-cf29-45ed-9747-bf80d5ef47fa tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:27.485270 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2b690430-b403-43c0-b488-8d0794487ba1 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:27.485606 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-635f8bec-cf29-45ed-9747-bf80d5ef47fa tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:27.485715 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2b690430-b403-43c0-b488-8d0794487ba1 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:27.486038 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-635f8bec-cf29-45ed-9747-bf80d5ef47fa tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:27.486146 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2b690430-b403-43c0-b488-8d0794487ba1 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:27.486729 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-635f8bec-cf29-45ed-9747-bf80d5ef47fa tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:27.486836 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2b690430-b403-43c0-b488-8d0794487ba1 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:27.487193 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2b690430-b403-43c0-b488-8d0794487ba1 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:27.487302 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-635f8bec-cf29-45ed-9747-bf80d5ef47fa tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:27.487608 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2b690430-b403-43c0-b488-8d0794487ba1 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:27.487728 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-635f8bec-cf29-45ed-9747-bf80d5ef47fa tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:27.684514 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-2b690430-b403-43c0-b488-8d0794487ba1 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:27.689745 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-635f8bec-cf29-45ed-9747-bf80d5ef47fa tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:27.693470 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-2b690430-b403-43c0-b488-8d0794487ba1 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1520 microversion: 2.1 time: 0.220208 Sep 06 01:13:27.694042 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 143/278] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:27 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:27.698872 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-635f8bec-cf29-45ed-9747-bf80d5ef47fa tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:27.700479 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-635f8bec-cf29-45ed-9747-bf80d5ef47fa tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:27.701898 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-635f8bec-cf29-45ed-9747-bf80d5ef47fa tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1724 microversion: 2.20 time: 0.228446 Sep 06 01:13:27.702469 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 136/279] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:13:27 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:13:28.030851 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-fa48d5ed-17c6-4c80-9444-8eabb4a0920b tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:28.031590 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-fa48d5ed-17c6-4c80-9444-8eabb4a0920b tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: ca3a12a4-8200-4090-b6ea-b41f0fdd46a6] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:28.038102 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fa48d5ed-17c6-4c80-9444-8eabb4a0920b tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:28.038581 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fa48d5ed-17c6-4c80-9444-8eabb4a0920b tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:28.039011 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fa48d5ed-17c6-4c80-9444-8eabb4a0920b tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:28.039698 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fa48d5ed-17c6-4c80-9444-8eabb4a0920b tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:28.040167 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fa48d5ed-17c6-4c80-9444-8eabb4a0920b tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:28.040581 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fa48d5ed-17c6-4c80-9444-8eabb4a0920b tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:28.117490 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dac404b0-8fd2-4920-91f3-194c5f0de772 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f2a8a28f-117f-4bcb-b1f6-e0f5341762b0", "device": "/dev/sdb"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:13:28.121054 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-dac404b0-8fd2-4920-91f3-194c5f0de772 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 7589d872-fdde-4504-b16e-1f16598c41d3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:28.129416 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dac404b0-8fd2-4920-91f3-194c5f0de772 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:28.129924 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dac404b0-8fd2-4920-91f3-194c5f0de772 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:28.130356 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dac404b0-8fd2-4920-91f3-194c5f0de772 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:28.131074 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dac404b0-8fd2-4920-91f3-194c5f0de772 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:28.131518 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dac404b0-8fd2-4920-91f3-194c5f0de772 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:28.132577 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dac404b0-8fd2-4920-91f3-194c5f0de772 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:28.173935 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-fa48d5ed-17c6-4c80-9444-8eabb4a0920b tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:28.181907 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-fa48d5ed-17c6-4c80-9444-8eabb4a0920b tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6" status: 200 len: 1313 microversion: 2.1 time: 0.155211 Sep 06 01:13:28.182457 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 144/280] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:28 2022] GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:28.383317 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dac404b0-8fd2-4920-91f3-194c5f0de772 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "POST /compute/v2.1/servers/7589d872-fdde-4504-b16e-1f16598c41d3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269515 Sep 06 01:13:28.389530 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 137/281] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Sep 6 01:13:28 2022] POST /compute/v2.1/servers/7589d872-fdde-4504-b16e-1f16598c41d3/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 01:13:28.417836 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-3900a187-f299-4610-b6a3-35453af20445 req-cc90266f-44b3-4415-9091-ef1ac1a43749 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca3a12a4-8200-4090-b6ea-b41f0fdd46a6", "name": "network-vif-plugged", "status": "completed", "tag": "08782fbc-65be-42e4-9894-f8d8247f12e9"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:13:28.432347 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-3900a187-f299-4610-b6a3-35453af20445 req-cc90266f-44b3-4415-9091-ef1ac1a43749 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:28.432977 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-3900a187-f299-4610-b6a3-35453af20445 req-cc90266f-44b3-4415-9091-ef1ac1a43749 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:28.433325 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-3900a187-f299-4610-b6a3-35453af20445 req-cc90266f-44b3-4415-9091-ef1ac1a43749 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:28.448478 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.compute.server_external_events [req-3900a187-f299-4610-b6a3-35453af20445 req-cc90266f-44b3-4415-9091-ef1ac1a43749 service nova] Creating event network-vif-plugged:08782fbc-65be-42e4-9894-f8d8247f12e9 for instance ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 on hv-cinder-84773 Sep 06 01:13:28.454802 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [req-3900a187-f299-4610-b6a3-35453af20445 req-cc90266f-44b3-4415-9091-ef1ac1a43749 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041211 Sep 06 01:13:28.455484 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 145/282] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 01:13:28.717686 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a8df8201-a9fb-4d3d-a79b-17b5d60ece4f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:28.718405 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a8df8201-a9fb-4d3d-a79b-17b5d60ece4f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:28.725163 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8df8201-a9fb-4d3d-a79b-17b5d60ece4f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:28.726157 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8df8201-a9fb-4d3d-a79b-17b5d60ece4f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:28.726591 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8df8201-a9fb-4d3d-a79b-17b5d60ece4f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:28.727277 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8df8201-a9fb-4d3d-a79b-17b5d60ece4f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:28.727725 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8df8201-a9fb-4d3d-a79b-17b5d60ece4f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:28.728164 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8df8201-a9fb-4d3d-a79b-17b5d60ece4f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:28.728822 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-d80ac44a-de76-4bd1-9866-e1b9d5cce547 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:28.729524 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-d80ac44a-de76-4bd1-9866-e1b9d5cce547 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:28.735595 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d80ac44a-de76-4bd1-9866-e1b9d5cce547 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:28.736105 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d80ac44a-de76-4bd1-9866-e1b9d5cce547 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:28.736541 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d80ac44a-de76-4bd1-9866-e1b9d5cce547 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:28.737221 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d80ac44a-de76-4bd1-9866-e1b9d5cce547 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:28.737667 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d80ac44a-de76-4bd1-9866-e1b9d5cce547 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:28.738083 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d80ac44a-de76-4bd1-9866-e1b9d5cce547 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:28.927529 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-d80ac44a-de76-4bd1-9866-e1b9d5cce547 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:28.931594 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-a8df8201-a9fb-4d3d-a79b-17b5d60ece4f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:28.935961 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-d80ac44a-de76-4bd1-9866-e1b9d5cce547 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:28.937469 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-d80ac44a-de76-4bd1-9866-e1b9d5cce547 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:28.938657 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-d80ac44a-de76-4bd1-9866-e1b9d5cce547 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1724 microversion: 2.20 time: 0.215067 Sep 06 01:13:28.939274 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a8df8201-a9fb-4d3d-a79b-17b5d60ece4f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1520 microversion: 2.1 time: 0.225825 Sep 06 01:13:28.939411 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 146/283] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:13:28 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:13:28.939841 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 138/284] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:28 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:29.205035 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-5b399f29-c913-4a0f-b949-28b77abda411 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:29.205705 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-5b399f29-c913-4a0f-b949-28b77abda411 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: ca3a12a4-8200-4090-b6ea-b41f0fdd46a6] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:29.212285 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5b399f29-c913-4a0f-b949-28b77abda411 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:29.212761 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5b399f29-c913-4a0f-b949-28b77abda411 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:29.213193 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5b399f29-c913-4a0f-b949-28b77abda411 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:29.213872 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5b399f29-c913-4a0f-b949-28b77abda411 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:29.214326 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5b399f29-c913-4a0f-b949-28b77abda411 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:29.214746 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5b399f29-c913-4a0f-b949-28b77abda411 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:29.355566 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-5b399f29-c913-4a0f-b949-28b77abda411 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:29.359123 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:29.364244 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-5b399f29-c913-4a0f-b949-28b77abda411 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6" status: 200 len: 1313 microversion: 2.1 time: 0.163004 Sep 06 01:13:29.364800 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 147/285] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:29 2022] GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:29.961865 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9fba7165-1f7d-4060-a775-1e6d95711a5b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:29.962959 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9fba7165-1f7d-4060-a775-1e6d95711a5b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:29.967430 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-747729a8-14ae-411f-92b0-ed3faec93025 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:29.968681 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-747729a8-14ae-411f-92b0-ed3faec93025 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:29.971338 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9fba7165-1f7d-4060-a775-1e6d95711a5b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:29.972476 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9fba7165-1f7d-4060-a775-1e6d95711a5b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:29.973156 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9fba7165-1f7d-4060-a775-1e6d95711a5b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:29.974113 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9fba7165-1f7d-4060-a775-1e6d95711a5b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:29.975015 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9fba7165-1f7d-4060-a775-1e6d95711a5b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:29.976583 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9fba7165-1f7d-4060-a775-1e6d95711a5b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:29.982527 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-747729a8-14ae-411f-92b0-ed3faec93025 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:29.983165 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-747729a8-14ae-411f-92b0-ed3faec93025 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:29.983636 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-747729a8-14ae-411f-92b0-ed3faec93025 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:29.984365 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-747729a8-14ae-411f-92b0-ed3faec93025 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:29.984816 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-747729a8-14ae-411f-92b0-ed3faec93025 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:29.985234 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-747729a8-14ae-411f-92b0-ed3faec93025 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:29.994727 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:30.195858 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-9fba7165-1f7d-4060-a775-1e6d95711a5b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:30.200150 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-747729a8-14ae-411f-92b0-ed3faec93025 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:30.204836 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9fba7165-1f7d-4060-a775-1e6d95711a5b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1520 microversion: 2.1 time: 0.247860 Sep 06 01:13:30.205912 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 139/286] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:29 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:30.209153 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-747729a8-14ae-411f-92b0-ed3faec93025 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:30.210746 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-747729a8-14ae-411f-92b0-ed3faec93025 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:30.212006 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-747729a8-14ae-411f-92b0-ed3faec93025 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1724 microversion: 2.20 time: 0.251953 Sep 06 01:13:30.212670 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 148/287] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:13:29 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1724 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:13:30.386699 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e4476805-ecbe-4b4a-b6ce-d3803e6933be tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:30.387279 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e4476805-ecbe-4b4a-b6ce-d3803e6933be tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: ca3a12a4-8200-4090-b6ea-b41f0fdd46a6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:30.393146 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e4476805-ecbe-4b4a-b6ce-d3803e6933be tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:30.393626 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e4476805-ecbe-4b4a-b6ce-d3803e6933be tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:30.394061 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e4476805-ecbe-4b4a-b6ce-d3803e6933be tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:30.394740 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e4476805-ecbe-4b4a-b6ce-d3803e6933be tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:30.395191 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e4476805-ecbe-4b4a-b6ce-d3803e6933be tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:30.395611 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e4476805-ecbe-4b4a-b6ce-d3803e6933be tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:30.520536 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-e4476805-ecbe-4b4a-b6ce-d3803e6933be tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:30.528667 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e4476805-ecbe-4b4a-b6ce-d3803e6933be tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6" status: 200 len: 1313 microversion: 2.1 time: 0.145859 Sep 06 01:13:30.529230 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 140/288] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:30 2022] GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:31.228467 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-8d644fd8-501b-43b0-940a-8925bce40248 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:31.229077 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-8d644fd8-501b-43b0-940a-8925bce40248 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:31.235685 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8d644fd8-501b-43b0-940a-8925bce40248 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:31.236194 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8d644fd8-501b-43b0-940a-8925bce40248 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:31.236681 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8d644fd8-501b-43b0-940a-8925bce40248 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:31.237327 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8d644fd8-501b-43b0-940a-8925bce40248 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:31.237562 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a452f581-b1cc-4d83-a507-159915f422f6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:31.237970 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8d644fd8-501b-43b0-940a-8925bce40248 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:31.238187 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8d644fd8-501b-43b0-940a-8925bce40248 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:31.238347 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a452f581-b1cc-4d83-a507-159915f422f6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:31.244349 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a452f581-b1cc-4d83-a507-159915f422f6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:31.244824 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a452f581-b1cc-4d83-a507-159915f422f6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:31.245252 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a452f581-b1cc-4d83-a507-159915f422f6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:31.245928 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a452f581-b1cc-4d83-a507-159915f422f6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:31.246374 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a452f581-b1cc-4d83-a507-159915f422f6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:31.246788 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a452f581-b1cc-4d83-a507-159915f422f6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:31.432572 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-8d644fd8-501b-43b0-940a-8925bce40248 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:31.436487 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-a452f581-b1cc-4d83-a507-159915f422f6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:31.440316 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-8d644fd8-501b-43b0-940a-8925bce40248 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1520 microversion: 2.1 time: 0.216343 Sep 06 01:13:31.440871 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 149/289] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:31 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:31.444973 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-a452f581-b1cc-4d83-a507-159915f422f6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:31.446431 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-a452f581-b1cc-4d83-a507-159915f422f6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:31.447586 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a452f581-b1cc-4d83-a507-159915f422f6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1724 microversion: 2.20 time: 0.214198 Sep 06 01:13:31.448320 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 141/290] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:13:31 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:13:31.551973 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-147414ee-4e65-4077-b5fd-1d3468472c58 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:31.552508 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-147414ee-4e65-4077-b5fd-1d3468472c58 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: ca3a12a4-8200-4090-b6ea-b41f0fdd46a6] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:31.558796 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-147414ee-4e65-4077-b5fd-1d3468472c58 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:31.559274 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-147414ee-4e65-4077-b5fd-1d3468472c58 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:31.559699 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-147414ee-4e65-4077-b5fd-1d3468472c58 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:31.560396 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-147414ee-4e65-4077-b5fd-1d3468472c58 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:31.560842 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-147414ee-4e65-4077-b5fd-1d3468472c58 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:31.561259 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-147414ee-4e65-4077-b5fd-1d3468472c58 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:31.688525 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-147414ee-4e65-4077-b5fd-1d3468472c58 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:31.696548 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-147414ee-4e65-4077-b5fd-1d3468472c58 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6" status: 200 len: 1497 microversion: 2.1 time: 0.148414 Sep 06 01:13:31.697095 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 150/291] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:31 2022] GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 => generated 1497 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:32.463135 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-aa9c576c-1213-4af9-9950-fa6a74a632af tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:32.463745 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-aa9c576c-1213-4af9-9950-fa6a74a632af tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:32.470134 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa9c576c-1213-4af9-9950-fa6a74a632af tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:32.470613 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa9c576c-1213-4af9-9950-fa6a74a632af tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:32.471048 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa9c576c-1213-4af9-9950-fa6a74a632af tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:32.471734 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa9c576c-1213-4af9-9950-fa6a74a632af tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:32.472217 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa9c576c-1213-4af9-9950-fa6a74a632af tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:32.472638 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa9c576c-1213-4af9-9950-fa6a74a632af tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:32.473060 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-0c846d86-32e2-496b-bdee-7b64ae4ee8bb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:32.473675 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-0c846d86-32e2-496b-bdee-7b64ae4ee8bb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:32.480795 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0c846d86-32e2-496b-bdee-7b64ae4ee8bb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:32.481178 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0c846d86-32e2-496b-bdee-7b64ae4ee8bb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:32.481614 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0c846d86-32e2-496b-bdee-7b64ae4ee8bb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:32.482301 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0c846d86-32e2-496b-bdee-7b64ae4ee8bb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:32.482751 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0c846d86-32e2-496b-bdee-7b64ae4ee8bb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:32.483161 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0c846d86-32e2-496b-bdee-7b64ae4ee8bb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:32.659202 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-aa9c576c-1213-4af9-9950-fa6a74a632af tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:32.669706 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-aa9c576c-1213-4af9-9950-fa6a74a632af tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1520 microversion: 2.1 time: 0.210432 Sep 06 01:13:32.670506 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 142/292] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:32 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:32.671319 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-0c846d86-32e2-496b-bdee-7b64ae4ee8bb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:32.679628 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-0c846d86-32e2-496b-bdee-7b64ae4ee8bb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:32.681093 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-0c846d86-32e2-496b-bdee-7b64ae4ee8bb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:32.682275 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-0c846d86-32e2-496b-bdee-7b64ae4ee8bb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1724 microversion: 2.20 time: 0.213112 Sep 06 01:13:32.682817 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 151/293] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:13:32 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:13:33.692204 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ef913e71-dfdd-4788-9856-5fdcbc02e607 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:33.692806 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ef913e71-dfdd-4788-9856-5fdcbc02e607 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:33.699609 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef913e71-dfdd-4788-9856-5fdcbc02e607 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:33.700126 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef913e71-dfdd-4788-9856-5fdcbc02e607 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:33.700555 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef913e71-dfdd-4788-9856-5fdcbc02e607 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:33.701232 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef913e71-dfdd-4788-9856-5fdcbc02e607 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:33.701682 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef913e71-dfdd-4788-9856-5fdcbc02e607 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:33.702097 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef913e71-dfdd-4788-9856-5fdcbc02e607 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:33.706365 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-e2854fac-2d9b-4ead-a560-a5bb421ee35c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:33.706980 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-e2854fac-2d9b-4ead-a560-a5bb421ee35c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:33.713989 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e2854fac-2d9b-4ead-a560-a5bb421ee35c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:33.714503 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e2854fac-2d9b-4ead-a560-a5bb421ee35c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:33.714942 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e2854fac-2d9b-4ead-a560-a5bb421ee35c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:33.715634 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e2854fac-2d9b-4ead-a560-a5bb421ee35c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:33.716383 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e2854fac-2d9b-4ead-a560-a5bb421ee35c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:33.716808 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e2854fac-2d9b-4ead-a560-a5bb421ee35c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:33.895257 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-ef913e71-dfdd-4788-9856-5fdcbc02e607 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:33.906421 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ef913e71-dfdd-4788-9856-5fdcbc02e607 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1520 microversion: 2.1 time: 0.217983 Sep 06 01:13:33.920272 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 143/294] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:33 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:33.920618 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-e2854fac-2d9b-4ead-a560-a5bb421ee35c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:33.921996 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-e2854fac-2d9b-4ead-a560-a5bb421ee35c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:33.923450 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-e2854fac-2d9b-4ead-a560-a5bb421ee35c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:33.924670 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-e2854fac-2d9b-4ead-a560-a5bb421ee35c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1724 microversion: 2.20 time: 0.222183 Sep 06 01:13:33.925212 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 152/295] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:13:33 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:13:34.930217 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-646e8d31-95bb-424b-ac99-8c70fdc36a4a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:34.930827 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-646e8d31-95bb-424b-ac99-8c70fdc36a4a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:34.937518 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-646e8d31-95bb-424b-ac99-8c70fdc36a4a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:34.937999 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-646e8d31-95bb-424b-ac99-8c70fdc36a4a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:34.938460 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-646e8d31-95bb-424b-ac99-8c70fdc36a4a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:34.939140 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-646e8d31-95bb-424b-ac99-8c70fdc36a4a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:34.939590 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-646e8d31-95bb-424b-ac99-8c70fdc36a4a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:34.940044 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-646e8d31-95bb-424b-ac99-8c70fdc36a4a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:34.950052 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-30bbb985-5812-4139-9534-a41027d41658 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:34.950850 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-30bbb985-5812-4139-9534-a41027d41658 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:34.957784 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-30bbb985-5812-4139-9534-a41027d41658 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:34.958472 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-30bbb985-5812-4139-9534-a41027d41658 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:34.958892 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-30bbb985-5812-4139-9534-a41027d41658 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:34.959569 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-30bbb985-5812-4139-9534-a41027d41658 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:34.960528 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-30bbb985-5812-4139-9534-a41027d41658 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:34.960951 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-30bbb985-5812-4139-9534-a41027d41658 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:35.127408 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-646e8d31-95bb-424b-ac99-8c70fdc36a4a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:35.135420 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-646e8d31-95bb-424b-ac99-8c70fdc36a4a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1520 microversion: 2.1 time: 0.209015 Sep 06 01:13:35.136009 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 144/296] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:34 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:35.148908 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-30bbb985-5812-4139-9534-a41027d41658 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:35.157426 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-30bbb985-5812-4139-9534-a41027d41658 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:35.158867 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-30bbb985-5812-4139-9534-a41027d41658 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:35.160028 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-30bbb985-5812-4139-9534-a41027d41658 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1724 microversion: 2.20 time: 0.213902 Sep 06 01:13:35.160589 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 153/297] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:13:34 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:13:36.159166 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0436ec01-1cd4-45fd-871f-78dbea3a3b1d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:36.159790 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0436ec01-1cd4-45fd-871f-78dbea3a3b1d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:36.162048 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=72 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:36.167541 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0436ec01-1cd4-45fd-871f-78dbea3a3b1d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:36.168069 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0436ec01-1cd4-45fd-871f-78dbea3a3b1d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:36.168753 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0436ec01-1cd4-45fd-871f-78dbea3a3b1d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:36.169434 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0436ec01-1cd4-45fd-871f-78dbea3a3b1d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:36.169881 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0436ec01-1cd4-45fd-871f-78dbea3a3b1d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:36.170299 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0436ec01-1cd4-45fd-871f-78dbea3a3b1d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:36.186564 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-1a536cac-318d-4882-abec-3fcc3dfa3344 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:36.187164 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-1a536cac-318d-4882-abec-3fcc3dfa3344 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:36.193405 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1a536cac-318d-4882-abec-3fcc3dfa3344 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:36.193878 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1a536cac-318d-4882-abec-3fcc3dfa3344 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:36.194305 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1a536cac-318d-4882-abec-3fcc3dfa3344 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:36.194989 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1a536cac-318d-4882-abec-3fcc3dfa3344 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:36.195435 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1a536cac-318d-4882-abec-3fcc3dfa3344 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:36.195880 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1a536cac-318d-4882-abec-3fcc3dfa3344 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:36.366493 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-0436ec01-1cd4-45fd-871f-78dbea3a3b1d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:36.373102 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-1a536cac-318d-4882-abec-3fcc3dfa3344 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:36.374036 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0436ec01-1cd4-45fd-871f-78dbea3a3b1d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1520 microversion: 2.1 time: 0.218805 Sep 06 01:13:36.374722 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 145/298] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:36 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:36.380986 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-1a536cac-318d-4882-abec-3fcc3dfa3344 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:36.382457 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-1a536cac-318d-4882-abec-3fcc3dfa3344 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:36.383597 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-1a536cac-318d-4882-abec-3fcc3dfa3344 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1724 microversion: 2.20 time: 0.200905 Sep 06 01:13:36.384157 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 154/299] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:13:36 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:13:36.829183 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9919c903-cf67-4ba1-a5a5-224efc50d309 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:36.829838 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9919c903-cf67-4ba1-a5a5-224efc50d309 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: ca3a12a4-8200-4090-b6ea-b41f0fdd46a6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:36.836736 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9919c903-cf67-4ba1-a5a5-224efc50d309 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:36.837314 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9919c903-cf67-4ba1-a5a5-224efc50d309 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:36.837820 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9919c903-cf67-4ba1-a5a5-224efc50d309 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:36.838688 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9919c903-cf67-4ba1-a5a5-224efc50d309 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:36.839218 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9919c903-cf67-4ba1-a5a5-224efc50d309 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:36.839712 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9919c903-cf67-4ba1-a5a5-224efc50d309 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:36.868432 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9919c903-cf67-4ba1-a5a5-224efc50d309 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: ca3a12a4-8200-4090-b6ea-b41f0fdd46a6] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 01:13:36.879450 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-0ec80897-ff4b-4977-9d18-600bf36986dd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Action: 'create', calling method: .version_select at 0x7fb06e2f0700>, body: {"keypair": {"name": "tempest-keypair-1364060931", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXsZnYQYmatCO0lXhUd5KnEAh1FWEH8OGcdQEI37EJU1e9bM07ELZi52Go3JSxVU6H8ZeXcThVuQFz1biM8PNGPW+eFglHTfMxBgjuGGCh7GGA3vf2puQEFfT2qrhhYsg=="}} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:13:36.895639 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.quota [None req-0ec80897-ff4b-4977-9d18-600bf36986dd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Getting quotas for project 1fa73b0bfee14a9ea25f03e523078995. Resources: {'key_pairs'} {{(pid=120580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 01:13:36.900429 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.quota [None req-0ec80897-ff4b-4977-9d18-600bf36986dd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Getting quotas for user f8f44df824414e5ebc8cfd2126e9d66f and project 1fa73b0bfee14a9ea25f03e523078995. Resources: {'key_pairs'} {{(pid=120580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 01:13:36.924420 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-0ec80897-ff4b-4977-9d18-600bf36986dd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048668 Sep 06 01:13:36.925010 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 155/300] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Sep 6 01:13:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 01:13:36.952705 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9919c903-cf67-4ba1-a5a5-224efc50d309 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6" status: 204 len: 0 microversion: 2.1 time: 0.127191 Sep 06 01:13:36.953708 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 146/301] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 6 01:13:36 2022] DELETE /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 01:13:36.963537 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-f6ec5ecb-af2c-4a3f-94ad-bc56031fddfa tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:36.964181 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-f6ec5ecb-af2c-4a3f-94ad-bc56031fddfa tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: ca3a12a4-8200-4090-b6ea-b41f0fdd46a6] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:36.970516 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f6ec5ecb-af2c-4a3f-94ad-bc56031fddfa tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:36.971002 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f6ec5ecb-af2c-4a3f-94ad-bc56031fddfa tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:36.971432 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f6ec5ecb-af2c-4a3f-94ad-bc56031fddfa tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:36.972180 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f6ec5ecb-af2c-4a3f-94ad-bc56031fddfa tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:36.972633 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f6ec5ecb-af2c-4a3f-94ad-bc56031fddfa tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:36.973057 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f6ec5ecb-af2c-4a3f-94ad-bc56031fddfa tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:37.124524 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-f6ec5ecb-af2c-4a3f-94ad-bc56031fddfa tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:37.132749 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-f6ec5ecb-af2c-4a3f-94ad-bc56031fddfa tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6" status: 200 len: 1503 microversion: 2.1 time: 0.174912 Sep 06 01:13:37.133313 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 156/302] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:36 2022] GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 => generated 1503 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:37.397409 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9dfc54ba-8e36-4693-a2f2-25eeedf31f60 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:37.398101 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9dfc54ba-8e36-4693-a2f2-25eeedf31f60 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:37.404498 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9dfc54ba-8e36-4693-a2f2-25eeedf31f60 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:37.405945 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9dfc54ba-8e36-4693-a2f2-25eeedf31f60 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:37.405945 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9dfc54ba-8e36-4693-a2f2-25eeedf31f60 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:37.406168 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9dfc54ba-8e36-4693-a2f2-25eeedf31f60 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:37.406602 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9dfc54ba-8e36-4693-a2f2-25eeedf31f60 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:37.407026 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9dfc54ba-8e36-4693-a2f2-25eeedf31f60 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:37.410779 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-04e0a068-4073-4f79-bc90-73e81292ad83 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:37.412011 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-04e0a068-4073-4f79-bc90-73e81292ad83 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:37.415843 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:37.422361 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-04e0a068-4073-4f79-bc90-73e81292ad83 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:37.422860 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-04e0a068-4073-4f79-bc90-73e81292ad83 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:37.423296 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-04e0a068-4073-4f79-bc90-73e81292ad83 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:37.424194 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-04e0a068-4073-4f79-bc90-73e81292ad83 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:37.424813 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-04e0a068-4073-4f79-bc90-73e81292ad83 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:37.425243 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-04e0a068-4073-4f79-bc90-73e81292ad83 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:37.564664 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-9dfc54ba-8e36-4693-a2f2-25eeedf31f60 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:37.586927 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9dfc54ba-8e36-4693-a2f2-25eeedf31f60 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1520 microversion: 2.1 time: 0.179869 Sep 06 01:13:37.600210 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 147/303] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:37 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:37.700088 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-04e0a068-4073-4f79-bc90-73e81292ad83 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:37.709267 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-04e0a068-4073-4f79-bc90-73e81292ad83 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:37.710529 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-04e0a068-4073-4f79-bc90-73e81292ad83 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:37.711696 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-04e0a068-4073-4f79-bc90-73e81292ad83 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1724 microversion: 2.20 time: 0.304678 Sep 06 01:13:37.712265 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 157/304] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:13:37 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1724 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:13:38.155794 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8f72da8f-43d7-4436-994e-06d1406c6936 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:38.156870 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8f72da8f-43d7-4436-994e-06d1406c6936 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: ca3a12a4-8200-4090-b6ea-b41f0fdd46a6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:38.169503 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8f72da8f-43d7-4436-994e-06d1406c6936 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:38.170454 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8f72da8f-43d7-4436-994e-06d1406c6936 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:38.171222 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8f72da8f-43d7-4436-994e-06d1406c6936 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:38.172036 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8f72da8f-43d7-4436-994e-06d1406c6936 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:38.172507 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8f72da8f-43d7-4436-994e-06d1406c6936 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:38.175074 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8f72da8f-43d7-4436-994e-06d1406c6936 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:38.314746 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-12655ff4-c909-487b-bdf1-ca2ddd4f2452 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1382967750", "imageRef": "768973cc-7b5f-4eed-b493-e40eb0de9f88", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d10b81f4-8ccb-48ae-aa86-1440cea903cc"}], "security_groups": [{"name": "tempest-securitygroup--1940376724"}], "key_name": "tempest-keypair-1364060931", "user_data": "}} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:13:38.315188 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-8f72da8f-43d7-4436-994e-06d1406c6936 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:38.324088 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8f72da8f-43d7-4436-994e-06d1406c6936 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6" status: 200 len: 1503 microversion: 2.1 time: 0.172872 Sep 06 01:13:38.324650 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 148/305] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:38 2022] GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 => generated 1503 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:38.416558 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.network.neutron [None req-12655ff4-c909-487b-bdf1-ca2ddd4f2452 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] validate_networks() for [('d10b81f4-8ccb-48ae-aa86-1440cea903cc', None, None, None, None, None)] {{(pid=120580) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 01:13:38.611062 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-01ca4529-17ca-4330-803e-1457d71caa90 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:38.611676 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-01ca4529-17ca-4330-803e-1457d71caa90 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:38.618708 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01ca4529-17ca-4330-803e-1457d71caa90 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:38.619274 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01ca4529-17ca-4330-803e-1457d71caa90 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:38.619948 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01ca4529-17ca-4330-803e-1457d71caa90 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:38.620795 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01ca4529-17ca-4330-803e-1457d71caa90 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:38.621257 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01ca4529-17ca-4330-803e-1457d71caa90 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:38.621712 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01ca4529-17ca-4330-803e-1457d71caa90 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:38.884760 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-01ca4529-17ca-4330-803e-1457d71caa90 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:38.892273 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-01ca4529-17ca-4330-803e-1457d71caa90 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1520 microversion: 2.1 time: 0.285159 Sep 06 01:13:38.893236 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 149/306] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:38 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1520 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:13:38.897280 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5e3b094c-9554-42b3-b393-9891f01cfc70 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:38.897876 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5e3b094c-9554-42b3-b393-9891f01cfc70 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:38.903276 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e3b094c-9554-42b3-b393-9891f01cfc70 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:38.903775 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e3b094c-9554-42b3-b393-9891f01cfc70 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:38.904291 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e3b094c-9554-42b3-b393-9891f01cfc70 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:38.904986 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e3b094c-9554-42b3-b393-9891f01cfc70 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:38.905795 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e3b094c-9554-42b3-b393-9891f01cfc70 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:38.905930 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e3b094c-9554-42b3-b393-9891f01cfc70 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:38.936440 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-12655ff4-c909-487b-bdf1-ca2ddd4f2452 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Flavor limits 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 01:13:38.936944 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-12655ff4-c909-487b-bdf1-ca2ddd4f2452 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Image limits 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 01:13:38.937447 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-12655ff4-c909-487b-bdf1-ca2ddd4f2452 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Flavor pref 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 01:13:38.937857 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-12655ff4-c909-487b-bdf1-ca2ddd4f2452 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Image pref 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 01:13:38.938268 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-12655ff4-c909-487b-bdf1-ca2ddd4f2452 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 01:13:38.946910 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-12655ff4-c909-487b-bdf1-ca2ddd4f2452 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:38.947396 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-12655ff4-c909-487b-bdf1-ca2ddd4f2452 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:38.947861 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-12655ff4-c909-487b-bdf1-ca2ddd4f2452 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:38.948592 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-12655ff4-c909-487b-bdf1-ca2ddd4f2452 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:38.949043 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-12655ff4-c909-487b-bdf1-ca2ddd4f2452 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:38.949467 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-12655ff4-c909-487b-bdf1-ca2ddd4f2452 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:38.965709 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.quota [None req-12655ff4-c909-487b-bdf1-ca2ddd4f2452 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Getting quotas for project 1fa73b0bfee14a9ea25f03e523078995. Resources: {'instances', 'ram', 'cores'} {{(pid=120580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 01:13:38.969646 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.quota [None req-12655ff4-c909-487b-bdf1-ca2ddd4f2452 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Getting quotas for user f8f44df824414e5ebc8cfd2126e9d66f and project 1fa73b0bfee14a9ea25f03e523078995. Resources: {'instances', 'ram', 'cores'} {{(pid=120580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 01:13:38.981028 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-12655ff4-c909-487b-bdf1-ca2ddd4f2452 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Going to run 1 instances... {{(pid=120580) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 01:13:38.983309 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-12655ff4-c909-487b-bdf1-ca2ddd4f2452 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='768973cc-7b5f-4eed-b493-e40eb0de9f88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 01:13:39.029282 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-12655ff4-c909-487b-bdf1-ca2ddd4f2452 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.719003 Sep 06 01:13:39.033147 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-5e3b094c-9554-42b3-b393-9891f01cfc70 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:39.036598 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 158/307] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Sep 6 01:13:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 01:13:39.041829 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-0812e220-be1f-4b72-98ef-320ce7706842 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:39.042288 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-5e3b094c-9554-42b3-b393-9891f01cfc70 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:39.042485 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-0812e220-be1f-4b72-98ef-320ce7706842 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:39.044026 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-5e3b094c-9554-42b3-b393-9891f01cfc70 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:39.045183 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5e3b094c-9554-42b3-b393-9891f01cfc70 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1724 microversion: 2.20 time: 0.151452 Sep 06 01:13:39.045740 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 150/308] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:13:38 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:13:39.105846 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-0812e220-be1f-4b72-98ef-320ce7706842 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:39.114248 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-0812e220-be1f-4b72-98ef-320ce7706842 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5" status: 200 len: 1242 microversion: 2.1 time: 0.076338 Sep 06 01:13:39.115576 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 159/309] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:39 2022] GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5 => generated 1242 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:39.349740 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-598902fa-3b34-4b25-bb90-181f7a8c2ad9 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:39.351440 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-598902fa-3b34-4b25-bb90-181f7a8c2ad9 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: ca3a12a4-8200-4090-b6ea-b41f0fdd46a6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:39.368759 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-598902fa-3b34-4b25-bb90-181f7a8c2ad9 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:39.372032 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-598902fa-3b34-4b25-bb90-181f7a8c2ad9 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:39.372507 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-598902fa-3b34-4b25-bb90-181f7a8c2ad9 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:39.375497 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-598902fa-3b34-4b25-bb90-181f7a8c2ad9 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:39.375985 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-598902fa-3b34-4b25-bb90-181f7a8c2ad9 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:39.379181 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-598902fa-3b34-4b25-bb90-181f7a8c2ad9 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:39.789752 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-598902fa-3b34-4b25-bb90-181f7a8c2ad9 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:39.799901 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-598902fa-3b34-4b25-bb90-181f7a8c2ad9 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6" status: 200 len: 1503 microversion: 2.1 time: 0.455920 Sep 06 01:13:39.816312 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 151/310] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:39 2022] GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 => generated 1503 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:39.915910 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-43620366-db43-4c47-bedc-fd9c72082512 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:39.916533 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-43620366-db43-4c47-bedc-fd9c72082512 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:39.923424 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-43620366-db43-4c47-bedc-fd9c72082512 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:39.924190 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-43620366-db43-4c47-bedc-fd9c72082512 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:39.924505 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-43620366-db43-4c47-bedc-fd9c72082512 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:39.925379 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-43620366-db43-4c47-bedc-fd9c72082512 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:39.925833 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-43620366-db43-4c47-bedc-fd9c72082512 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:39.926262 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-43620366-db43-4c47-bedc-fd9c72082512 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:40.071950 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-07f6eb9f-bae2-464c-905d-8a317f7f32f4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:40.072731 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-07f6eb9f-bae2-464c-905d-8a317f7f32f4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:40.078947 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-07f6eb9f-bae2-464c-905d-8a317f7f32f4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:40.079431 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-07f6eb9f-bae2-464c-905d-8a317f7f32f4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:40.079910 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-07f6eb9f-bae2-464c-905d-8a317f7f32f4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:40.080608 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-07f6eb9f-bae2-464c-905d-8a317f7f32f4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:40.081057 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-07f6eb9f-bae2-464c-905d-8a317f7f32f4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:40.081473 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-07f6eb9f-bae2-464c-905d-8a317f7f32f4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:40.377141 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-07f6eb9f-bae2-464c-905d-8a317f7f32f4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:40.385989 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-07f6eb9f-bae2-464c-905d-8a317f7f32f4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:40.387451 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-07f6eb9f-bae2-464c-905d-8a317f7f32f4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:40.389023 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-07f6eb9f-bae2-464c-905d-8a317f7f32f4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1724 microversion: 2.20 time: 0.322278 Sep 06 01:13:40.389580 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 152/311] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:13:40 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1724 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:13:40.393910 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9f778ba5-eb33-432a-af8e-56b18efd88de tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:40.394519 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9f778ba5-eb33-432a-af8e-56b18efd88de tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:40.400864 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f778ba5-eb33-432a-af8e-56b18efd88de tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:40.401359 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f778ba5-eb33-432a-af8e-56b18efd88de tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:40.401791 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f778ba5-eb33-432a-af8e-56b18efd88de tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:40.402486 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f778ba5-eb33-432a-af8e-56b18efd88de tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:40.402941 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f778ba5-eb33-432a-af8e-56b18efd88de tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:40.403369 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f778ba5-eb33-432a-af8e-56b18efd88de tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:40.422129 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-43620366-db43-4c47-bedc-fd9c72082512 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:40.429824 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-43620366-db43-4c47-bedc-fd9c72082512 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1520 microversion: 2.1 time: 0.518668 Sep 06 01:13:40.430543 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 160/312] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:39 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1520 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:40.466050 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-38e7276a-1647-4724-b530-8db1b7d9e8ca req-8cafb826-9c9f-4140-8217-43f7821ff05f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca3a12a4-8200-4090-b6ea-b41f0fdd46a6", "name": "network-vif-deleted", "tag": "08782fbc-65be-42e4-9894-f8d8247f12e9"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:13:40.475301 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-38e7276a-1647-4724-b530-8db1b7d9e8ca req-8cafb826-9c9f-4140-8217-43f7821ff05f service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:40.475786 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-38e7276a-1647-4724-b530-8db1b7d9e8ca req-8cafb826-9c9f-4140-8217-43f7821ff05f service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:40.476217 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-38e7276a-1647-4724-b530-8db1b7d9e8ca req-8cafb826-9c9f-4140-8217-43f7821ff05f service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:40.479932 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-9f778ba5-eb33-432a-af8e-56b18efd88de tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:40.487625 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.compute.server_external_events [req-38e7276a-1647-4724-b530-8db1b7d9e8ca req-8cafb826-9c9f-4140-8217-43f7821ff05f service nova] Creating event network-vif-deleted:08782fbc-65be-42e4-9894-f8d8247f12e9 for instance ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 on hv-cinder-84773 Sep 06 01:13:40.488321 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9f778ba5-eb33-432a-af8e-56b18efd88de tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5" status: 200 len: 1238 microversion: 2.1 time: 0.097705 Sep 06 01:13:40.488896 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 153/313] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:40 2022] GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5 => generated 1238 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:40.492931 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [req-38e7276a-1647-4724-b530-8db1b7d9e8ca req-8cafb826-9c9f-4140-8217-43f7821ff05f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030634 Sep 06 01:13:40.493508 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 161/314] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 01:13:40.822993 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e644cae9-089d-4c4d-94fa-7363cccd38af tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:40.823603 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e644cae9-089d-4c4d-94fa-7363cccd38af tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: ca3a12a4-8200-4090-b6ea-b41f0fdd46a6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:40.829914 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e644cae9-089d-4c4d-94fa-7363cccd38af tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:40.830394 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e644cae9-089d-4c4d-94fa-7363cccd38af tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:40.830828 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e644cae9-089d-4c4d-94fa-7363cccd38af tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:40.831511 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e644cae9-089d-4c4d-94fa-7363cccd38af tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:40.831993 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e644cae9-089d-4c4d-94fa-7363cccd38af tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:40.832422 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e644cae9-089d-4c4d-94fa-7363cccd38af tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:40.837109 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:40.900914 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-e644cae9-089d-4c4d-94fa-7363cccd38af tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:40.908495 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e644cae9-089d-4c4d-94fa-7363cccd38af tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6" status: 200 len: 1461 microversion: 2.1 time: 0.089920 Sep 06 01:13:40.909041 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 154/315] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:40 2022] GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 => generated 1461 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:41.415721 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-9972e671-1bc9-4eca-8030-72f9e862a8b2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:41.416366 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-9972e671-1bc9-4eca-8030-72f9e862a8b2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:41.422753 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9972e671-1bc9-4eca-8030-72f9e862a8b2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:41.423233 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9972e671-1bc9-4eca-8030-72f9e862a8b2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:41.423665 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9972e671-1bc9-4eca-8030-72f9e862a8b2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:41.424376 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9972e671-1bc9-4eca-8030-72f9e862a8b2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:41.424826 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9972e671-1bc9-4eca-8030-72f9e862a8b2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:41.425250 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9972e671-1bc9-4eca-8030-72f9e862a8b2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:41.452535 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-570db4ee-3f27-4c86-bc54-80fb3ec1355d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:41.453237 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-570db4ee-3f27-4c86-bc54-80fb3ec1355d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:41.459086 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-570db4ee-3f27-4c86-bc54-80fb3ec1355d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:41.460504 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-570db4ee-3f27-4c86-bc54-80fb3ec1355d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:41.460947 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-570db4ee-3f27-4c86-bc54-80fb3ec1355d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:41.461639 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-570db4ee-3f27-4c86-bc54-80fb3ec1355d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:41.462085 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-570db4ee-3f27-4c86-bc54-80fb3ec1355d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:41.462500 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-570db4ee-3f27-4c86-bc54-80fb3ec1355d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:41.605155 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-9972e671-1bc9-4eca-8030-72f9e862a8b2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:41.613081 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-9972e671-1bc9-4eca-8030-72f9e862a8b2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:41.614517 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-9972e671-1bc9-4eca-8030-72f9e862a8b2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:41.615663 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-9972e671-1bc9-4eca-8030-72f9e862a8b2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1724 microversion: 2.20 time: 0.204985 Sep 06 01:13:41.616714 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 162/316] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:13:41 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:13:41.621026 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-260fcdab-5edf-4797-8d8e-4f9f6c8cc53c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:41.621622 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-260fcdab-5edf-4797-8d8e-4f9f6c8cc53c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:41.627519 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-260fcdab-5edf-4797-8d8e-4f9f6c8cc53c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:41.628026 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-260fcdab-5edf-4797-8d8e-4f9f6c8cc53c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:41.628460 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-260fcdab-5edf-4797-8d8e-4f9f6c8cc53c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:41.629141 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-260fcdab-5edf-4797-8d8e-4f9f6c8cc53c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:41.629946 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-260fcdab-5edf-4797-8d8e-4f9f6c8cc53c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:41.630363 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-260fcdab-5edf-4797-8d8e-4f9f6c8cc53c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:41.632701 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-570db4ee-3f27-4c86-bc54-80fb3ec1355d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:41.640562 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-570db4ee-3f27-4c86-bc54-80fb3ec1355d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1520 microversion: 2.1 time: 0.191781 Sep 06 01:13:41.641294 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 155/317] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:41 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:13:41.690418 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-260fcdab-5edf-4797-8d8e-4f9f6c8cc53c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:41.698337 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-260fcdab-5edf-4797-8d8e-4f9f6c8cc53c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5" status: 200 len: 1238 microversion: 2.1 time: 0.080691 Sep 06 01:13:41.698881 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 163/318] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:41 2022] GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5 => generated 1238 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:41.933825 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cef2dd32-c736-408e-96ed-bc7190886837 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:41.934435 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cef2dd32-c736-408e-96ed-bc7190886837 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: ca3a12a4-8200-4090-b6ea-b41f0fdd46a6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:41.940790 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cef2dd32-c736-408e-96ed-bc7190886837 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:41.941208 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cef2dd32-c736-408e-96ed-bc7190886837 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:41.941664 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cef2dd32-c736-408e-96ed-bc7190886837 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:41.942337 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cef2dd32-c736-408e-96ed-bc7190886837 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:41.942781 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cef2dd32-c736-408e-96ed-bc7190886837 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:41.943195 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cef2dd32-c736-408e-96ed-bc7190886837 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:42.008813 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-cef2dd32-c736-408e-96ed-bc7190886837 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:42.018616 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cef2dd32-c736-408e-96ed-bc7190886837 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6" status: 200 len: 1461 microversion: 2.1 time: 0.088405 Sep 06 01:13:42.019195 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 156/319] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:41 2022] GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 => generated 1461 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:42.641755 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-0619c6ba-648b-4141-89ab-556c46237334 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:42.642368 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-0619c6ba-648b-4141-89ab-556c46237334 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:42.649340 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0619c6ba-648b-4141-89ab-556c46237334 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:42.649811 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0619c6ba-648b-4141-89ab-556c46237334 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:42.650239 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0619c6ba-648b-4141-89ab-556c46237334 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:42.650909 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0619c6ba-648b-4141-89ab-556c46237334 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:42.651353 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0619c6ba-648b-4141-89ab-556c46237334 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:42.651795 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0619c6ba-648b-4141-89ab-556c46237334 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:42.662722 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fff0e086-b0a6-4363-8d3e-54ba058b049c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:42.663337 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fff0e086-b0a6-4363-8d3e-54ba058b049c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:42.669623 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fff0e086-b0a6-4363-8d3e-54ba058b049c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:42.670112 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fff0e086-b0a6-4363-8d3e-54ba058b049c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:42.670554 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fff0e086-b0a6-4363-8d3e-54ba058b049c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:42.671303 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fff0e086-b0a6-4363-8d3e-54ba058b049c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:42.671885 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fff0e086-b0a6-4363-8d3e-54ba058b049c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:42.672193 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fff0e086-b0a6-4363-8d3e-54ba058b049c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:42.850523 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-0619c6ba-648b-4141-89ab-556c46237334 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:42.853559 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-fff0e086-b0a6-4363-8d3e-54ba058b049c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:42.860504 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-0619c6ba-648b-4141-89ab-556c46237334 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:42.861459 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fff0e086-b0a6-4363-8d3e-54ba058b049c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1520 microversion: 2.1 time: 0.202602 Sep 06 01:13:42.875774 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 157/320] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:42 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:13:42.876108 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-0619c6ba-648b-4141-89ab-556c46237334 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:42.876108 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-0619c6ba-648b-4141-89ab-556c46237334 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1724 microversion: 2.20 time: 0.225327 Sep 06 01:13:42.876293 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8f739cef-8854-4d3b-9897-fd1fa61584ec tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:42.876293 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8f739cef-8854-4d3b-9897-fd1fa61584ec tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:42.876425 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 164/321] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:13:42 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:13:42.876494 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8f739cef-8854-4d3b-9897-fd1fa61584ec tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:42.877040 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8f739cef-8854-4d3b-9897-fd1fa61584ec tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:42.877479 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8f739cef-8854-4d3b-9897-fd1fa61584ec tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:42.878666 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8f739cef-8854-4d3b-9897-fd1fa61584ec tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:42.879130 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8f739cef-8854-4d3b-9897-fd1fa61584ec tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:42.879557 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8f739cef-8854-4d3b-9897-fd1fa61584ec tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:42.940198 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-8f739cef-8854-4d3b-9897-fd1fa61584ec tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:42.948461 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8f739cef-8854-4d3b-9897-fd1fa61584ec tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5" status: 200 len: 1238 microversion: 2.1 time: 0.085460 Sep 06 01:13:42.949024 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 158/322] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:42 2022] GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5 => generated 1238 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:43.042255 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-5ecf70b8-5445-4a29-864a-d74c51eac08a tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:43.042877 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-5ecf70b8-5445-4a29-864a-d74c51eac08a tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: ca3a12a4-8200-4090-b6ea-b41f0fdd46a6] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:43.049245 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5ecf70b8-5445-4a29-864a-d74c51eac08a tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:43.049732 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5ecf70b8-5445-4a29-864a-d74c51eac08a tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:43.050171 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5ecf70b8-5445-4a29-864a-d74c51eac08a tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:43.050862 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5ecf70b8-5445-4a29-864a-d74c51eac08a tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:43.051315 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5ecf70b8-5445-4a29-864a-d74c51eac08a tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:43.051738 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5ecf70b8-5445-4a29-864a-d74c51eac08a tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:43.113015 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-5ecf70b8-5445-4a29-864a-d74c51eac08a tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:43.120994 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-5ecf70b8-5445-4a29-864a-d74c51eac08a tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6" status: 200 len: 1461 microversion: 2.1 time: 0.082514 Sep 06 01:13:43.121544 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 165/323] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:43 2022] GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 => generated 1461 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:43.886624 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-405d12aa-4a6b-42b8-a063-a05ff176c4fa tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:43.887180 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-405d12aa-4a6b-42b8-a063-a05ff176c4fa tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:43.887691 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-5d7e1cb1-f9d6-4669-a49a-1153aa8b01f5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:43.888350 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-5d7e1cb1-f9d6-4669-a49a-1153aa8b01f5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:43.893186 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-405d12aa-4a6b-42b8-a063-a05ff176c4fa tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:43.893669 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-405d12aa-4a6b-42b8-a063-a05ff176c4fa tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:43.894103 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-405d12aa-4a6b-42b8-a063-a05ff176c4fa tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:43.894822 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-405d12aa-4a6b-42b8-a063-a05ff176c4fa tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:43.894941 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5d7e1cb1-f9d6-4669-a49a-1153aa8b01f5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:43.895275 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-405d12aa-4a6b-42b8-a063-a05ff176c4fa tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:43.895385 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5d7e1cb1-f9d6-4669-a49a-1153aa8b01f5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:43.895702 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-405d12aa-4a6b-42b8-a063-a05ff176c4fa tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:43.895831 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5d7e1cb1-f9d6-4669-a49a-1153aa8b01f5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:43.896419 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5d7e1cb1-f9d6-4669-a49a-1153aa8b01f5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:43.896864 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5d7e1cb1-f9d6-4669-a49a-1153aa8b01f5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:43.897784 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5d7e1cb1-f9d6-4669-a49a-1153aa8b01f5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:44.096181 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-405d12aa-4a6b-42b8-a063-a05ff176c4fa tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:44.098948 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-5d7e1cb1-f9d6-4669-a49a-1153aa8b01f5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:44.104766 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-405d12aa-4a6b-42b8-a063-a05ff176c4fa tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1520 microversion: 2.1 time: 0.222333 Sep 06 01:13:44.105378 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 159/324] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:43 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:44.107688 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-5d7e1cb1-f9d6-4669-a49a-1153aa8b01f5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:44.109149 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-5d7e1cb1-f9d6-4669-a49a-1153aa8b01f5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:44.109828 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a19fbf8e-2792-4480-b300-307b29912759 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:44.110423 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a19fbf8e-2792-4480-b300-307b29912759 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:44.110870 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-5d7e1cb1-f9d6-4669-a49a-1153aa8b01f5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1724 microversion: 2.20 time: 0.226869 Sep 06 01:13:44.111484 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 166/325] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:13:43 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:13:44.116082 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a19fbf8e-2792-4480-b300-307b29912759 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:44.116558 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a19fbf8e-2792-4480-b300-307b29912759 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:44.116985 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a19fbf8e-2792-4480-b300-307b29912759 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:44.117664 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a19fbf8e-2792-4480-b300-307b29912759 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:44.118113 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a19fbf8e-2792-4480-b300-307b29912759 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:44.118531 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a19fbf8e-2792-4480-b300-307b29912759 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:44.144595 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-2e2bcc8f-7dc6-494b-871d-db8edc179bbb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:44.145145 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-2e2bcc8f-7dc6-494b-871d-db8edc179bbb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: ca3a12a4-8200-4090-b6ea-b41f0fdd46a6] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:44.151614 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2e2bcc8f-7dc6-494b-871d-db8edc179bbb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:44.152131 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2e2bcc8f-7dc6-494b-871d-db8edc179bbb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:44.152568 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2e2bcc8f-7dc6-494b-871d-db8edc179bbb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:44.153365 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2e2bcc8f-7dc6-494b-871d-db8edc179bbb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:44.153815 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2e2bcc8f-7dc6-494b-871d-db8edc179bbb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:44.154236 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2e2bcc8f-7dc6-494b-871d-db8edc179bbb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:44.178155 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-a19fbf8e-2792-4480-b300-307b29912759 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:44.185852 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a19fbf8e-2792-4480-b300-307b29912759 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5" status: 200 len: 1238 microversion: 2.1 time: 0.079524 Sep 06 01:13:44.186498 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 160/326] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:44 2022] GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5 => generated 1238 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:44.217918 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-2e2bcc8f-7dc6-494b-871d-db8edc179bbb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:44.221354 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell1:SELECT=100 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:44.226407 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-2e2bcc8f-7dc6-494b-871d-db8edc179bbb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6" status: 200 len: 1461 microversion: 2.1 time: 0.085757 Sep 06 01:13:44.226961 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 167/327] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:44 2022] GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 => generated 1461 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:13:45.126332 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bfc7f347-5d75-4af0-a59f-0c0929e73d61 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:45.126939 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bfc7f347-5d75-4af0-a59f-0c0929e73d61 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:45.133469 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfc7f347-5d75-4af0-a59f-0c0929e73d61 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:45.133889 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfc7f347-5d75-4af0-a59f-0c0929e73d61 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:45.134322 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfc7f347-5d75-4af0-a59f-0c0929e73d61 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:45.135003 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfc7f347-5d75-4af0-a59f-0c0929e73d61 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:45.135453 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfc7f347-5d75-4af0-a59f-0c0929e73d61 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:45.135903 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfc7f347-5d75-4af0-a59f-0c0929e73d61 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:45.136154 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-d393562a-4ba1-4fa5-aa4f-53021567d5bc tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:45.136765 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-d393562a-4ba1-4fa5-aa4f-53021567d5bc tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:45.143144 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d393562a-4ba1-4fa5-aa4f-53021567d5bc tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:45.143625 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d393562a-4ba1-4fa5-aa4f-53021567d5bc tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:45.144097 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d393562a-4ba1-4fa5-aa4f-53021567d5bc tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:45.144783 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d393562a-4ba1-4fa5-aa4f-53021567d5bc tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:45.145236 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d393562a-4ba1-4fa5-aa4f-53021567d5bc tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:45.145661 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d393562a-4ba1-4fa5-aa4f-53021567d5bc tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:45.320894 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-bfc7f347-5d75-4af0-a59f-0c0929e73d61 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:45.327526 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-d393562a-4ba1-4fa5-aa4f-53021567d5bc tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:45.328618 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bfc7f347-5d75-4af0-a59f-0c0929e73d61 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1520 microversion: 2.1 time: 0.206102 Sep 06 01:13:45.329483 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 161/328] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:45 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:45.334042 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-137d5d71-4eb3-4ee0-9d92-9f8c16b7472e tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:45.335266 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-137d5d71-4eb3-4ee0-9d92-9f8c16b7472e tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:45.342514 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-137d5d71-4eb3-4ee0-9d92-9f8c16b7472e tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:45.343003 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-137d5d71-4eb3-4ee0-9d92-9f8c16b7472e tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:45.343436 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-137d5d71-4eb3-4ee0-9d92-9f8c16b7472e tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:45.344156 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-137d5d71-4eb3-4ee0-9d92-9f8c16b7472e tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:45.344606 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-137d5d71-4eb3-4ee0-9d92-9f8c16b7472e tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:45.345319 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-137d5d71-4eb3-4ee0-9d92-9f8c16b7472e tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:45.352329 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-d393562a-4ba1-4fa5-aa4f-53021567d5bc tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:45.353998 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-d393562a-4ba1-4fa5-aa4f-53021567d5bc tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:45.355394 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-d393562a-4ba1-4fa5-aa4f-53021567d5bc tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1724 microversion: 2.20 time: 0.222880 Sep 06 01:13:45.356028 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 168/329] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:13:45 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:13:45.360965 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-9dec7fc3-a019-4ae3-9d1f-f634d4ceefe7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:45.361573 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-9dec7fc3-a019-4ae3-9d1f-f634d4ceefe7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: ca3a12a4-8200-4090-b6ea-b41f0fdd46a6] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:45.368560 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9dec7fc3-a019-4ae3-9d1f-f634d4ceefe7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:45.369271 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9dec7fc3-a019-4ae3-9d1f-f634d4ceefe7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:45.370177 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9dec7fc3-a019-4ae3-9d1f-f634d4ceefe7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:45.370413 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9dec7fc3-a019-4ae3-9d1f-f634d4ceefe7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:45.371068 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9dec7fc3-a019-4ae3-9d1f-f634d4ceefe7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:45.371502 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9dec7fc3-a019-4ae3-9d1f-f634d4ceefe7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:45.431874 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-137d5d71-4eb3-4ee0-9d92-9f8c16b7472e tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:45.439377 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-137d5d71-4eb3-4ee0-9d92-9f8c16b7472e tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5" status: 200 len: 1238 microversion: 2.1 time: 0.108927 Sep 06 01:13:45.439964 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 162/330] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:45 2022] GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5 => generated 1238 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:45.450729 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-9dec7fc3-a019-4ae3-9d1f-f634d4ceefe7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:45.458222 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-9dec7fc3-a019-4ae3-9d1f-f634d4ceefe7 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6" status: 200 len: 1461 microversion: 2.1 time: 0.101084 Sep 06 01:13:45.458759 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 169/331] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:45 2022] GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 => generated 1461 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:46.351612 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3d50254b-8bf2-4549-9ad0-8be1d55e29c7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:46.352249 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3d50254b-8bf2-4549-9ad0-8be1d55e29c7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:46.358775 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d50254b-8bf2-4549-9ad0-8be1d55e29c7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:46.359255 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d50254b-8bf2-4549-9ad0-8be1d55e29c7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:46.359689 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d50254b-8bf2-4549-9ad0-8be1d55e29c7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:46.361303 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d50254b-8bf2-4549-9ad0-8be1d55e29c7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:46.361812 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d50254b-8bf2-4549-9ad0-8be1d55e29c7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:46.362246 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d50254b-8bf2-4549-9ad0-8be1d55e29c7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:46.381176 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-6799e241-eb5e-44ba-ba5f-bf694a622424 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:46.382544 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-6799e241-eb5e-44ba-ba5f-bf694a622424 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:46.390140 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6799e241-eb5e-44ba-ba5f-bf694a622424 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:46.390635 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6799e241-eb5e-44ba-ba5f-bf694a622424 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:46.391071 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6799e241-eb5e-44ba-ba5f-bf694a622424 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:46.391777 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6799e241-eb5e-44ba-ba5f-bf694a622424 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:46.392247 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6799e241-eb5e-44ba-ba5f-bf694a622424 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:46.392671 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6799e241-eb5e-44ba-ba5f-bf694a622424 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:46.583204 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-3d50254b-8bf2-4549-9ad0-8be1d55e29c7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:46.584195 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-6799e241-eb5e-44ba-ba5f-bf694a622424 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:46.591862 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3d50254b-8bf2-4549-9ad0-8be1d55e29c7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1520 microversion: 2.1 time: 0.243936 Sep 06 01:13:46.592378 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 163/332] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:46 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:46.594169 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-6799e241-eb5e-44ba-ba5f-bf694a622424 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:46.595820 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-6799e241-eb5e-44ba-ba5f-bf694a622424 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:46.597053 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-de587755-030e-481e-9f81-fb6502a0121a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:46.597408 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-6799e241-eb5e-44ba-ba5f-bf694a622424 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1724 microversion: 2.20 time: 0.220220 Sep 06 01:13:46.597651 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-de587755-030e-481e-9f81-fb6502a0121a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:46.604160 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-de587755-030e-481e-9f81-fb6502a0121a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:46.604835 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-de587755-030e-481e-9f81-fb6502a0121a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:46.605422 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-de587755-030e-481e-9f81-fb6502a0121a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:46.606240 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-de587755-030e-481e-9f81-fb6502a0121a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:46.606838 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-de587755-030e-481e-9f81-fb6502a0121a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:46.607399 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-de587755-030e-481e-9f81-fb6502a0121a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:46.616648 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 170/333] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:13:46 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:13:46.621557 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-89d5bea1-4262-4b8c-b25d-4949680df732 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:46.622198 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-89d5bea1-4262-4b8c-b25d-4949680df732 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: ca3a12a4-8200-4090-b6ea-b41f0fdd46a6] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:46.628085 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-89d5bea1-4262-4b8c-b25d-4949680df732 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:46.628568 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-89d5bea1-4262-4b8c-b25d-4949680df732 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:46.629006 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-89d5bea1-4262-4b8c-b25d-4949680df732 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:46.629711 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-89d5bea1-4262-4b8c-b25d-4949680df732 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:46.630165 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-89d5bea1-4262-4b8c-b25d-4949680df732 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:46.630638 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-89d5bea1-4262-4b8c-b25d-4949680df732 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:46.672934 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-de587755-030e-481e-9f81-fb6502a0121a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:46.681994 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-de587755-030e-481e-9f81-fb6502a0121a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5" status: 200 len: 1238 microversion: 2.1 time: 0.088400 Sep 06 01:13:46.683506 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 164/334] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:46 2022] GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5 => generated 1238 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:46.702053 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-89d5bea1-4262-4b8c-b25d-4949680df732 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:46.710140 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-89d5bea1-4262-4b8c-b25d-4949680df732 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6" status: 200 len: 1461 microversion: 2.1 time: 0.092201 Sep 06 01:13:46.711031 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 171/335] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:46 2022] GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 => generated 1461 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:47.617452 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-53fefffc-8c15-4de2-bf13-b9ec06d66577 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:47.618053 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-53fefffc-8c15-4de2-bf13-b9ec06d66577 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:47.624533 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-53fefffc-8c15-4de2-bf13-b9ec06d66577 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:47.625015 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-53fefffc-8c15-4de2-bf13-b9ec06d66577 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:47.625168 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-e0fed626-4e15-4924-8276-3633c08b6fbd tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:47.625563 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-53fefffc-8c15-4de2-bf13-b9ec06d66577 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:47.625667 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-e0fed626-4e15-4924-8276-3633c08b6fbd tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:47.626112 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-53fefffc-8c15-4de2-bf13-b9ec06d66577 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:47.626561 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-53fefffc-8c15-4de2-bf13-b9ec06d66577 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:47.626980 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-53fefffc-8c15-4de2-bf13-b9ec06d66577 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:47.632562 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e0fed626-4e15-4924-8276-3633c08b6fbd tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:47.633044 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e0fed626-4e15-4924-8276-3633c08b6fbd tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:47.633481 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e0fed626-4e15-4924-8276-3633c08b6fbd tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:47.634168 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e0fed626-4e15-4924-8276-3633c08b6fbd tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:47.634620 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e0fed626-4e15-4924-8276-3633c08b6fbd tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:47.635044 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e0fed626-4e15-4924-8276-3633c08b6fbd tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:47.820885 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-e0fed626-4e15-4924-8276-3633c08b6fbd tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:47.824302 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-53fefffc-8c15-4de2-bf13-b9ec06d66577 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:47.829172 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-e0fed626-4e15-4924-8276-3633c08b6fbd tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:47.830715 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-e0fed626-4e15-4924-8276-3633c08b6fbd tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:47.831848 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-53fefffc-8c15-4de2-bf13-b9ec06d66577 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1520 microversion: 2.1 time: 0.218669 Sep 06 01:13:47.832034 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-e0fed626-4e15-4924-8276-3633c08b6fbd tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1724 microversion: 2.20 time: 0.210688 Sep 06 01:13:47.832412 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 165/336] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:47 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:47.844046 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 172/337] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:13:47 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:13:47.844179 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-58f190f7-d8a7-4f11-851a-4294de72e70d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:47.844259 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-5169c1b0-7f0c-46be-b90c-9801c4e44737 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:47.844356 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-58f190f7-d8a7-4f11-851a-4294de72e70d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:47.844432 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-5169c1b0-7f0c-46be-b90c-9801c4e44737 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: ca3a12a4-8200-4090-b6ea-b41f0fdd46a6] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:47.844432 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5169c1b0-7f0c-46be-b90c-9801c4e44737 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:47.844432 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5169c1b0-7f0c-46be-b90c-9801c4e44737 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:47.844633 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5169c1b0-7f0c-46be-b90c-9801c4e44737 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:47.845172 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5169c1b0-7f0c-46be-b90c-9801c4e44737 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:47.845627 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5169c1b0-7f0c-46be-b90c-9801c4e44737 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:47.846051 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5169c1b0-7f0c-46be-b90c-9801c4e44737 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:47.850806 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-58f190f7-d8a7-4f11-851a-4294de72e70d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:47.851319 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-58f190f7-d8a7-4f11-851a-4294de72e70d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:47.851767 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-58f190f7-d8a7-4f11-851a-4294de72e70d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:47.852500 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-58f190f7-d8a7-4f11-851a-4294de72e70d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:47.852948 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-58f190f7-d8a7-4f11-851a-4294de72e70d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:47.853395 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-58f190f7-d8a7-4f11-851a-4294de72e70d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:47.878013 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5169c1b0-7f0c-46be-b90c-9801c4e44737 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:47.878497 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5169c1b0-7f0c-46be-b90c-9801c4e44737 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:47.878933 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5169c1b0-7f0c-46be-b90c-9801c4e44737 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:47.879373 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.objects.instance [None req-5169c1b0-7f0c-46be-b90c-9801c4e44737 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lazy-loading 'fault' on Instance uuid ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 {{(pid=120580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 01:13:47.938206 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-58f190f7-d8a7-4f11-851a-4294de72e70d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:47.939862 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-5169c1b0-7f0c-46be-b90c-9801c4e44737 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:47.945801 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-58f190f7-d8a7-4f11-851a-4294de72e70d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5" status: 200 len: 1294 microversion: 2.1 time: 0.112313 Sep 06 01:13:47.946362 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 166/338] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:47 2022] GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5 => generated 1294 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:47.947460 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-5169c1b0-7f0c-46be-b90c-9801c4e44737 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6" status: 200 len: 1303 microversion: 2.1 time: 0.113587 Sep 06 01:13:47.948040 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 173/339] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:47 2022] GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 => generated 1303 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:48.857092 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4383df3a-9108-46e3-92dd-33457e3810ff tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:48.857620 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-60bbf03f-db3e-4588-adbf-a16d17ad38ad tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:48.857620 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-60bbf03f-db3e-4588-adbf-a16d17ad38ad tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:48.858077 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4383df3a-9108-46e3-92dd-33457e3810ff tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:48.864186 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-60bbf03f-db3e-4588-adbf-a16d17ad38ad tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:48.864359 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4383df3a-9108-46e3-92dd-33457e3810ff tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:48.864674 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-60bbf03f-db3e-4588-adbf-a16d17ad38ad tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:48.864785 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4383df3a-9108-46e3-92dd-33457e3810ff tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:48.865107 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-60bbf03f-db3e-4588-adbf-a16d17ad38ad tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:48.865205 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4383df3a-9108-46e3-92dd-33457e3810ff tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:48.865806 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-60bbf03f-db3e-4588-adbf-a16d17ad38ad tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:48.865909 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4383df3a-9108-46e3-92dd-33457e3810ff tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:48.866258 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-60bbf03f-db3e-4588-adbf-a16d17ad38ad tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:48.866363 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4383df3a-9108-46e3-92dd-33457e3810ff tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:48.866682 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-60bbf03f-db3e-4588-adbf-a16d17ad38ad tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:48.866790 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4383df3a-9108-46e3-92dd-33457e3810ff tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:48.956540 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell0:SELECT=2 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:49.058476 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-4383df3a-9108-46e3-92dd-33457e3810ff tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:49.061637 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-60bbf03f-db3e-4588-adbf-a16d17ad38ad tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:49.066403 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4383df3a-9108-46e3-92dd-33457e3810ff tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1520 microversion: 2.1 time: 0.213266 Sep 06 01:13:49.067057 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 167/340] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:48 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:49.070483 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-60bbf03f-db3e-4588-adbf-a16d17ad38ad tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:49.072202 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-60bbf03f-db3e-4588-adbf-a16d17ad38ad tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:49.072874 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3129a0bc-0485-47f6-8920-5bda48fd29a6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:49.073583 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3129a0bc-0485-47f6-8920-5bda48fd29a6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:49.074460 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-60bbf03f-db3e-4588-adbf-a16d17ad38ad tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1724 microversion: 2.20 time: 0.221103 Sep 06 01:13:49.080198 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3129a0bc-0485-47f6-8920-5bda48fd29a6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:49.080751 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3129a0bc-0485-47f6-8920-5bda48fd29a6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:49.081252 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3129a0bc-0485-47f6-8920-5bda48fd29a6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:49.082042 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3129a0bc-0485-47f6-8920-5bda48fd29a6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:49.082555 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3129a0bc-0485-47f6-8920-5bda48fd29a6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:49.083101 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3129a0bc-0485-47f6-8920-5bda48fd29a6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:49.083855 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 174/341] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:13:48 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1724 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:13:49.088808 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-cc11b90f-178b-4735-86a3-79b001d61e7b tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:49.089424 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-cc11b90f-178b-4735-86a3-79b001d61e7b tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: ca3a12a4-8200-4090-b6ea-b41f0fdd46a6] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:49.097047 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cc11b90f-178b-4735-86a3-79b001d61e7b tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:49.097636 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cc11b90f-178b-4735-86a3-79b001d61e7b tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:49.098096 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cc11b90f-178b-4735-86a3-79b001d61e7b tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:49.098808 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cc11b90f-178b-4735-86a3-79b001d61e7b tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:49.099297 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cc11b90f-178b-4735-86a3-79b001d61e7b tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:49.099722 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cc11b90f-178b-4735-86a3-79b001d61e7b tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:49.117523 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell0:SELECT=12 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:49.134479 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cc11b90f-178b-4735-86a3-79b001d61e7b tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:49.134960 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cc11b90f-178b-4735-86a3-79b001d61e7b tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:49.135392 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cc11b90f-178b-4735-86a3-79b001d61e7b tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:49.135858 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.objects.instance [None req-cc11b90f-178b-4735-86a3-79b001d61e7b tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lazy-loading 'fault' on Instance uuid ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 {{(pid=120580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 01:13:49.149340 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-3129a0bc-0485-47f6-8920-5bda48fd29a6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:49.157288 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3129a0bc-0485-47f6-8920-5bda48fd29a6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5" status: 200 len: 1294 microversion: 2.1 time: 0.089170 Sep 06 01:13:49.157846 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 168/342] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:49 2022] GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5 => generated 1294 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:49.181225 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-cc11b90f-178b-4735-86a3-79b001d61e7b tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:49.190104 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-cc11b90f-178b-4735-86a3-79b001d61e7b tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6" status: 200 len: 1303 microversion: 2.1 time: 0.105067 Sep 06 01:13:49.190675 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 175/343] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:49 2022] GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 => generated 1303 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:50.091069 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c3ac9336-fe59-4f30-a39f-2270c772eed7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:50.091610 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c3ac9336-fe59-4f30-a39f-2270c772eed7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:50.097993 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3ac9336-fe59-4f30-a39f-2270c772eed7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:50.098566 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3ac9336-fe59-4f30-a39f-2270c772eed7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:50.099023 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3ac9336-fe59-4f30-a39f-2270c772eed7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:50.099705 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3ac9336-fe59-4f30-a39f-2270c772eed7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:50.100792 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3ac9336-fe59-4f30-a39f-2270c772eed7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:50.101211 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3ac9336-fe59-4f30-a39f-2270c772eed7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:50.104029 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-740795f8-bee9-47bf-a60b-10d0b3f1f0b4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:50.104645 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-740795f8-bee9-47bf-a60b-10d0b3f1f0b4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:50.111038 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-740795f8-bee9-47bf-a60b-10d0b3f1f0b4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:50.111526 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-740795f8-bee9-47bf-a60b-10d0b3f1f0b4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:50.112005 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-740795f8-bee9-47bf-a60b-10d0b3f1f0b4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:50.112701 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-740795f8-bee9-47bf-a60b-10d0b3f1f0b4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:50.113158 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-740795f8-bee9-47bf-a60b-10d0b3f1f0b4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:50.113581 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-740795f8-bee9-47bf-a60b-10d0b3f1f0b4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:50.307223 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-740795f8-bee9-47bf-a60b-10d0b3f1f0b4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:50.316185 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-740795f8-bee9-47bf-a60b-10d0b3f1f0b4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:50.317650 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-740795f8-bee9-47bf-a60b-10d0b3f1f0b4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:50.319375 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-740795f8-bee9-47bf-a60b-10d0b3f1f0b4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1724 microversion: 2.20 time: 0.219408 Sep 06 01:13:50.332470 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 176/344] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:13:50 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:13:50.343266 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-dd51dada-8524-4c6d-9110-2107772747cf tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:50.343919 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-dd51dada-8524-4c6d-9110-2107772747cf tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:50.344251 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-c3ac9336-fe59-4f30-a39f-2270c772eed7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:50.351511 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dd51dada-8524-4c6d-9110-2107772747cf tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:50.352385 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dd51dada-8524-4c6d-9110-2107772747cf tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:50.352833 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dd51dada-8524-4c6d-9110-2107772747cf tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:50.353539 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dd51dada-8524-4c6d-9110-2107772747cf tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:50.354174 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dd51dada-8524-4c6d-9110-2107772747cf tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:50.354582 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c3ac9336-fe59-4f30-a39f-2270c772eed7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1520 microversion: 2.1 time: 0.267412 Sep 06 01:13:50.354757 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dd51dada-8524-4c6d-9110-2107772747cf tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:50.356060 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 169/345] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:50 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1520 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:50.362054 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c90c1d18-3eb4-4581-9d74-655e3921e548 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:50.362880 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c90c1d18-3eb4-4581-9d74-655e3921e548 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: ca3a12a4-8200-4090-b6ea-b41f0fdd46a6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:50.370006 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c90c1d18-3eb4-4581-9d74-655e3921e548 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:50.370751 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c90c1d18-3eb4-4581-9d74-655e3921e548 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:50.371541 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c90c1d18-3eb4-4581-9d74-655e3921e548 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:50.372592 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c90c1d18-3eb4-4581-9d74-655e3921e548 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:50.373281 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c90c1d18-3eb4-4581-9d74-655e3921e548 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:50.374200 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c90c1d18-3eb4-4581-9d74-655e3921e548 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:50.422731 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c90c1d18-3eb4-4581-9d74-655e3921e548 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:50.423268 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c90c1d18-3eb4-4581-9d74-655e3921e548 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:50.423699 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c90c1d18-3eb4-4581-9d74-655e3921e548 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:50.424180 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-c90c1d18-3eb4-4581-9d74-655e3921e548 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lazy-loading 'fault' on Instance uuid ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 01:13:50.430461 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:50.440755 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-dd51dada-8524-4c6d-9110-2107772747cf tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:50.453006 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-dd51dada-8524-4c6d-9110-2107772747cf tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5" status: 200 len: 1294 microversion: 2.1 time: 0.119388 Sep 06 01:13:50.453581 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 177/346] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:50 2022] GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5 => generated 1294 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:50.471926 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-c90c1d18-3eb4-4581-9d74-655e3921e548 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:50.480451 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c90c1d18-3eb4-4581-9d74-655e3921e548 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6" status: 200 len: 1303 microversion: 2.1 time: 0.123051 Sep 06 01:13:50.481212 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 170/347] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:50 2022] GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 => generated 1303 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:51.350879 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-868c0a12-21a6-4730-a84a-4aafbb33dfdb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:51.351559 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-868c0a12-21a6-4730-a84a-4aafbb33dfdb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:51.358560 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-868c0a12-21a6-4730-a84a-4aafbb33dfdb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:51.359158 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-868c0a12-21a6-4730-a84a-4aafbb33dfdb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:51.359602 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-868c0a12-21a6-4730-a84a-4aafbb33dfdb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:51.360352 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-868c0a12-21a6-4730-a84a-4aafbb33dfdb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:51.360808 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-868c0a12-21a6-4730-a84a-4aafbb33dfdb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:51.361234 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-868c0a12-21a6-4730-a84a-4aafbb33dfdb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:51.380907 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d9ff563e-8d70-4994-8e24-a3380b6a3f26 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:51.383047 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d9ff563e-8d70-4994-8e24-a3380b6a3f26 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:51.398734 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d9ff563e-8d70-4994-8e24-a3380b6a3f26 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:51.399512 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d9ff563e-8d70-4994-8e24-a3380b6a3f26 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:51.400181 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d9ff563e-8d70-4994-8e24-a3380b6a3f26 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:51.401262 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d9ff563e-8d70-4994-8e24-a3380b6a3f26 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:51.401904 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d9ff563e-8d70-4994-8e24-a3380b6a3f26 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:51.402728 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d9ff563e-8d70-4994-8e24-a3380b6a3f26 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:51.614788 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-868c0a12-21a6-4730-a84a-4aafbb33dfdb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:51.619898 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-d9ff563e-8d70-4994-8e24-a3380b6a3f26 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:51.624357 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-868c0a12-21a6-4730-a84a-4aafbb33dfdb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:51.626348 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-868c0a12-21a6-4730-a84a-4aafbb33dfdb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:51.627565 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-868c0a12-21a6-4730-a84a-4aafbb33dfdb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1745 microversion: 2.20 time: 0.281435 Sep 06 01:13:51.628255 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 178/348] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:13:51 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1745 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:13:51.633819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-44da6152-431d-49f2-8fd7-fdf0a7b5b428 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:51.634680 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-44da6152-431d-49f2-8fd7-fdf0a7b5b428 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:51.638193 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d9ff563e-8d70-4994-8e24-a3380b6a3f26 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1520 microversion: 2.1 time: 0.262871 Sep 06 01:13:51.639165 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 171/349] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:51 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1520 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:13:51.643730 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dd474ad4-b986-4d79-b06c-979f4408c6d4 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:51.644446 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-dd474ad4-b986-4d79-b06c-979f4408c6d4 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: ca3a12a4-8200-4090-b6ea-b41f0fdd46a6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:51.649739 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-44da6152-431d-49f2-8fd7-fdf0a7b5b428 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:51.650317 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-44da6152-431d-49f2-8fd7-fdf0a7b5b428 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:51.651116 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-44da6152-431d-49f2-8fd7-fdf0a7b5b428 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:51.651981 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-44da6152-431d-49f2-8fd7-fdf0a7b5b428 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:51.652665 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-44da6152-431d-49f2-8fd7-fdf0a7b5b428 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:51.652843 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd474ad4-b986-4d79-b06c-979f4408c6d4 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:51.653100 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-44da6152-431d-49f2-8fd7-fdf0a7b5b428 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:51.653300 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd474ad4-b986-4d79-b06c-979f4408c6d4 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:51.653732 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd474ad4-b986-4d79-b06c-979f4408c6d4 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:51.654434 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd474ad4-b986-4d79-b06c-979f4408c6d4 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:51.654891 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd474ad4-b986-4d79-b06c-979f4408c6d4 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:51.655317 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd474ad4-b986-4d79-b06c-979f4408c6d4 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:51.689027 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd474ad4-b986-4d79-b06c-979f4408c6d4 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:51.689695 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd474ad4-b986-4d79-b06c-979f4408c6d4 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:51.690552 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd474ad4-b986-4d79-b06c-979f4408c6d4 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:51.691326 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-dd474ad4-b986-4d79-b06c-979f4408c6d4 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lazy-loading 'fault' on Instance uuid ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 01:13:51.744861 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-44da6152-431d-49f2-8fd7-fdf0a7b5b428 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:51.746622 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-dd474ad4-b986-4d79-b06c-979f4408c6d4 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:51.752518 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-44da6152-431d-49f2-8fd7-fdf0a7b5b428 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5" status: 200 len: 1294 microversion: 2.1 time: 0.122795 Sep 06 01:13:51.753081 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 179/350] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:51 2022] GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5 => generated 1294 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:51.754130 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dd474ad4-b986-4d79-b06c-979f4408c6d4 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6" status: 200 len: 1303 microversion: 2.1 time: 0.114010 Sep 06 01:13:51.754674 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 172/351] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:51 2022] GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 => generated 1303 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:52.654476 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-9f900e47-e314-407b-875c-35b899a8fe2f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:52.655091 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-9f900e47-e314-407b-875c-35b899a8fe2f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:52.661187 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9f900e47-e314-407b-875c-35b899a8fe2f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:52.661674 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9f900e47-e314-407b-875c-35b899a8fe2f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:52.662109 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9f900e47-e314-407b-875c-35b899a8fe2f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:52.663176 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9937bdd3-eec0-46bb-a11c-a8eb5e9904c3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:52.663589 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9f900e47-e314-407b-875c-35b899a8fe2f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:52.663733 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9f900e47-e314-407b-875c-35b899a8fe2f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:52.664008 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9937bdd3-eec0-46bb-a11c-a8eb5e9904c3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:52.664180 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9f900e47-e314-407b-875c-35b899a8fe2f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:52.670745 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9937bdd3-eec0-46bb-a11c-a8eb5e9904c3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:52.671310 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9937bdd3-eec0-46bb-a11c-a8eb5e9904c3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:52.671829 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9937bdd3-eec0-46bb-a11c-a8eb5e9904c3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:52.672584 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9937bdd3-eec0-46bb-a11c-a8eb5e9904c3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:52.673104 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9937bdd3-eec0-46bb-a11c-a8eb5e9904c3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:52.673617 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9937bdd3-eec0-46bb-a11c-a8eb5e9904c3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:52.859819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-9f900e47-e314-407b-875c-35b899a8fe2f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:52.866623 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-9937bdd3-eec0-46bb-a11c-a8eb5e9904c3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:52.867810 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-9f900e47-e314-407b-875c-35b899a8fe2f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:52.869252 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-9f900e47-e314-407b-875c-35b899a8fe2f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:52.870400 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-9f900e47-e314-407b-875c-35b899a8fe2f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1745 microversion: 2.20 time: 0.220080 Sep 06 01:13:52.870945 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 180/352] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:13:52 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1745 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:13:52.874386 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9937bdd3-eec0-46bb-a11c-a8eb5e9904c3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1520 microversion: 2.1 time: 0.216009 Sep 06 01:13:52.874945 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 173/353] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:52 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:52.875547 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-c54a64a8-fc64-4f17-93f3-0ea129e377f0 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:52.876222 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-c54a64a8-fc64-4f17-93f3-0ea129e377f0 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:52.880468 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8d7e616c-590a-4df5-817f-82da3ce1da54 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:52.881641 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8d7e616c-590a-4df5-817f-82da3ce1da54 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: ca3a12a4-8200-4090-b6ea-b41f0fdd46a6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:52.882481 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c54a64a8-fc64-4f17-93f3-0ea129e377f0 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:52.882964 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c54a64a8-fc64-4f17-93f3-0ea129e377f0 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:52.883442 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c54a64a8-fc64-4f17-93f3-0ea129e377f0 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:52.884293 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c54a64a8-fc64-4f17-93f3-0ea129e377f0 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:52.884877 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c54a64a8-fc64-4f17-93f3-0ea129e377f0 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:52.885426 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c54a64a8-fc64-4f17-93f3-0ea129e377f0 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:52.887819 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d7e616c-590a-4df5-817f-82da3ce1da54 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:52.888470 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d7e616c-590a-4df5-817f-82da3ce1da54 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:52.888903 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d7e616c-590a-4df5-817f-82da3ce1da54 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:52.889742 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d7e616c-590a-4df5-817f-82da3ce1da54 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:52.890373 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d7e616c-590a-4df5-817f-82da3ce1da54 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:52.890819 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d7e616c-590a-4df5-817f-82da3ce1da54 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:52.921919 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d7e616c-590a-4df5-817f-82da3ce1da54 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:52.922400 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d7e616c-590a-4df5-817f-82da3ce1da54 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:52.922836 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d7e616c-590a-4df5-817f-82da3ce1da54 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:52.923276 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-8d7e616c-590a-4df5-817f-82da3ce1da54 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lazy-loading 'fault' on Instance uuid ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 01:13:52.949462 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-c54a64a8-fc64-4f17-93f3-0ea129e377f0 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:52.957387 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-c54a64a8-fc64-4f17-93f3-0ea129e377f0 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5" status: 200 len: 1294 microversion: 2.1 time: 0.085303 Sep 06 01:13:52.957948 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 181/354] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:52 2022] GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5 => generated 1294 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:52.976149 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-8d7e616c-590a-4df5-817f-82da3ce1da54 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:52.983816 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8d7e616c-590a-4df5-817f-82da3ce1da54 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6" status: 200 len: 1303 microversion: 2.1 time: 0.107617 Sep 06 01:13:52.984366 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 174/355] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:52 2022] GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 => generated 1303 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:53.895950 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-9610ef2f-be9c-4e6c-a80a-c5e6d6097ba6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:53.896502 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-9610ef2f-be9c-4e6c-a80a-c5e6d6097ba6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:53.897104 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-917cea3f-cf3d-4d74-984e-274c797ebd1c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:53.897716 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-917cea3f-cf3d-4d74-984e-274c797ebd1c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:53.902892 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9610ef2f-be9c-4e6c-a80a-c5e6d6097ba6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:53.903369 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9610ef2f-be9c-4e6c-a80a-c5e6d6097ba6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:53.903819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9610ef2f-be9c-4e6c-a80a-c5e6d6097ba6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:53.903925 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-917cea3f-cf3d-4d74-984e-274c797ebd1c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:53.904387 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-917cea3f-cf3d-4d74-984e-274c797ebd1c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:53.904509 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9610ef2f-be9c-4e6c-a80a-c5e6d6097ba6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:53.904823 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-917cea3f-cf3d-4d74-984e-274c797ebd1c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:53.904927 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9610ef2f-be9c-4e6c-a80a-c5e6d6097ba6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:53.905385 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9610ef2f-be9c-4e6c-a80a-c5e6d6097ba6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:53.905592 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-917cea3f-cf3d-4d74-984e-274c797ebd1c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:53.906051 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-917cea3f-cf3d-4d74-984e-274c797ebd1c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:53.906473 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-917cea3f-cf3d-4d74-984e-274c797ebd1c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:54.097469 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-9610ef2f-be9c-4e6c-a80a-c5e6d6097ba6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:54.101045 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-917cea3f-cf3d-4d74-984e-274c797ebd1c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:54.106156 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-9610ef2f-be9c-4e6c-a80a-c5e6d6097ba6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:54.107601 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-9610ef2f-be9c-4e6c-a80a-c5e6d6097ba6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:54.108681 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-917cea3f-cf3d-4d74-984e-274c797ebd1c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1520 microversion: 2.1 time: 0.215358 Sep 06 01:13:54.108795 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-9610ef2f-be9c-4e6c-a80a-c5e6d6097ba6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1745 microversion: 2.20 time: 0.216886 Sep 06 01:13:54.117861 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 175/356] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:53 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1520 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:13:54.117861 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9fb70a4d-813b-482b-b946-0de6c23fb3d6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:54.117861 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9fb70a4d-813b-482b-b946-0de6c23fb3d6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:54.118172 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 182/357] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:13:53 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1745 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:13:54.120585 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9fb70a4d-813b-482b-b946-0de6c23fb3d6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:54.121229 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9fb70a4d-813b-482b-b946-0de6c23fb3d6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:54.121836 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9fb70a4d-813b-482b-b946-0de6c23fb3d6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:54.122578 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-a1ea2137-9c18-4f15-b316-e82da54099bb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:54.122839 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9fb70a4d-813b-482b-b946-0de6c23fb3d6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:54.123321 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-a1ea2137-9c18-4f15-b316-e82da54099bb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: ca3a12a4-8200-4090-b6ea-b41f0fdd46a6] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:54.123670 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9fb70a4d-813b-482b-b946-0de6c23fb3d6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:54.124357 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9fb70a4d-813b-482b-b946-0de6c23fb3d6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:54.129525 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a1ea2137-9c18-4f15-b316-e82da54099bb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:54.130007 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a1ea2137-9c18-4f15-b316-e82da54099bb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:54.130440 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a1ea2137-9c18-4f15-b316-e82da54099bb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:54.131283 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a1ea2137-9c18-4f15-b316-e82da54099bb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:54.131735 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a1ea2137-9c18-4f15-b316-e82da54099bb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:54.132186 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a1ea2137-9c18-4f15-b316-e82da54099bb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:54.163129 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a1ea2137-9c18-4f15-b316-e82da54099bb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:54.163518 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a1ea2137-9c18-4f15-b316-e82da54099bb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:54.163975 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a1ea2137-9c18-4f15-b316-e82da54099bb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:54.164444 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.objects.instance [None req-a1ea2137-9c18-4f15-b316-e82da54099bb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lazy-loading 'fault' on Instance uuid ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 {{(pid=120580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 01:13:54.167168 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell1:SELECT=100 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:13:54.190510 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-9fb70a4d-813b-482b-b946-0de6c23fb3d6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:54.198064 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9fb70a4d-813b-482b-b946-0de6c23fb3d6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5" status: 200 len: 1302 microversion: 2.1 time: 0.087862 Sep 06 01:13:54.198625 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 176/358] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:54 2022] GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5 => generated 1302 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:54.215539 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-a1ea2137-9c18-4f15-b316-e82da54099bb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:54.223177 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-a1ea2137-9c18-4f15-b316-e82da54099bb tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6" status: 200 len: 1303 microversion: 2.1 time: 0.105783 Sep 06 01:13:54.223779 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 183/359] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:54 2022] GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 => generated 1303 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:55.133961 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f6694116-7afb-47eb-bc36-86a996b1ad1d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:55.134654 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f6694116-7afb-47eb-bc36-86a996b1ad1d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:55.136138 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-c41ab1db-df71-4844-9507-b0d582d52372 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:55.136559 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-c41ab1db-df71-4844-9507-b0d582d52372 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:55.141889 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f6694116-7afb-47eb-bc36-86a996b1ad1d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:55.142376 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f6694116-7afb-47eb-bc36-86a996b1ad1d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:55.142811 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f6694116-7afb-47eb-bc36-86a996b1ad1d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:55.143503 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f6694116-7afb-47eb-bc36-86a996b1ad1d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:55.143624 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c41ab1db-df71-4844-9507-b0d582d52372 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:55.143982 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f6694116-7afb-47eb-bc36-86a996b1ad1d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:55.144115 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c41ab1db-df71-4844-9507-b0d582d52372 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:55.144402 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f6694116-7afb-47eb-bc36-86a996b1ad1d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:55.144509 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c41ab1db-df71-4844-9507-b0d582d52372 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:55.145105 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c41ab1db-df71-4844-9507-b0d582d52372 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:55.145550 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c41ab1db-df71-4844-9507-b0d582d52372 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:55.145968 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c41ab1db-df71-4844-9507-b0d582d52372 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:55.375117 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-f6694116-7afb-47eb-bc36-86a996b1ad1d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:55.385359 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f6694116-7afb-47eb-bc36-86a996b1ad1d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1500 microversion: 2.1 time: 0.255976 Sep 06 01:13:55.385877 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 177/360] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:55 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1500 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:55.408526 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-84b23009-39ea-4e7b-a383-fe5eb8e0299c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:55.409392 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-84b23009-39ea-4e7b-a383-fe5eb8e0299c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:55.414192 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-c41ab1db-df71-4844-9507-b0d582d52372 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:55.416449 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-84b23009-39ea-4e7b-a383-fe5eb8e0299c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:55.417100 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-84b23009-39ea-4e7b-a383-fe5eb8e0299c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:55.417696 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-84b23009-39ea-4e7b-a383-fe5eb8e0299c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:55.419011 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-84b23009-39ea-4e7b-a383-fe5eb8e0299c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:55.419630 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-84b23009-39ea-4e7b-a383-fe5eb8e0299c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:55.420245 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-84b23009-39ea-4e7b-a383-fe5eb8e0299c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:55.425645 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-c41ab1db-df71-4844-9507-b0d582d52372 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:55.428838 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-c41ab1db-df71-4844-9507-b0d582d52372 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:55.432214 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-c41ab1db-df71-4844-9507-b0d582d52372 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1745 microversion: 2.20 time: 0.301589 Sep 06 01:13:55.444743 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 184/361] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:13:55 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1745 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:13:55.444743 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-0089f661-c55c-4bc6-b879-f248a33ad776 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:55.445437 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-0089f661-c55c-4bc6-b879-f248a33ad776 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: ca3a12a4-8200-4090-b6ea-b41f0fdd46a6] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:55.454241 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0089f661-c55c-4bc6-b879-f248a33ad776 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:55.454747 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0089f661-c55c-4bc6-b879-f248a33ad776 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:55.455184 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0089f661-c55c-4bc6-b879-f248a33ad776 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:55.456397 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0089f661-c55c-4bc6-b879-f248a33ad776 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:55.456888 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0089f661-c55c-4bc6-b879-f248a33ad776 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:55.457537 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0089f661-c55c-4bc6-b879-f248a33ad776 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:55.489439 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0089f661-c55c-4bc6-b879-f248a33ad776 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:55.490233 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0089f661-c55c-4bc6-b879-f248a33ad776 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:55.491297 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0089f661-c55c-4bc6-b879-f248a33ad776 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:55.491910 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.objects.instance [None req-0089f661-c55c-4bc6-b879-f248a33ad776 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lazy-loading 'fault' on Instance uuid ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 {{(pid=120580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 01:13:55.532757 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-84b23009-39ea-4e7b-a383-fe5eb8e0299c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:55.542508 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-84b23009-39ea-4e7b-a383-fe5eb8e0299c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5" status: 200 len: 1312 microversion: 2.1 time: 0.138638 Sep 06 01:13:55.543509 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 178/362] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:55 2022] GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5 => generated 1312 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:55.548583 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-59537637-773b-46dd-b3c5-d6fb85bed3ec tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0b24b6c0-cca8-47c5-8fb2-5b29f16fe13f"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:13:55.552431 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-59537637-773b-46dd-b3c5-d6fb85bed3ec tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:55.559425 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-59537637-773b-46dd-b3c5-d6fb85bed3ec tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:55.560375 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-59537637-773b-46dd-b3c5-d6fb85bed3ec tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:55.560841 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-59537637-773b-46dd-b3c5-d6fb85bed3ec tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:55.561527 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-59537637-773b-46dd-b3c5-d6fb85bed3ec tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:55.561981 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-59537637-773b-46dd-b3c5-d6fb85bed3ec tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:55.562401 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-59537637-773b-46dd-b3c5-d6fb85bed3ec tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:55.566471 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-0089f661-c55c-4bc6-b879-f248a33ad776 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453fa4c58743419bb29e5f01d9f78041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ead4033c51d4658a5406c045da1c26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:55.575518 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-0089f661-c55c-4bc6-b879-f248a33ad776 tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6" status: 200 len: 1303 microversion: 2.1 time: 0.137411 Sep 06 01:13:55.576240 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 185/363] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:55 2022] GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 => generated 1303 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:55.581661 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-7bf078b1-1ac8-4580-99fd-12f458f5a491 req-deee34fe-7f28-435d-bd44-cd921bc63627 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c42df4ca-a678-4b12-b5dc-3f3c0af93125", "name": "network-vif-plugged", "status": "completed", "tag": "9f5084ac-bd14-44b7-bba5-06b59fd5291e"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:13:55.595861 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-7bf078b1-1ac8-4580-99fd-12f458f5a491 req-deee34fe-7f28-435d-bd44-cd921bc63627 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:55.596599 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-7bf078b1-1ac8-4580-99fd-12f458f5a491 req-deee34fe-7f28-435d-bd44-cd921bc63627 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:55.597233 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-7bf078b1-1ac8-4580-99fd-12f458f5a491 req-deee34fe-7f28-435d-bd44-cd921bc63627 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:55.598461 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-59537637-773b-46dd-b3c5-d6fb85bed3ec tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] HTTP exception thrown: Cannot 'attach_volume' instance cf424d2a-0a95-48dc-9ee5-13fab569cb43 while it is in vm_state rescued Sep 06 01:13:55.601215 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-59537637-773b-46dd-b3c5-d6fb85bed3ec tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Request method failure captured: Sep 06 01:13:55.601215 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: request: POST /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43/os-volume_attachments HTTP/1.1 Sep 06 01:13:55.601215 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept: application/json Sep 06 01:13:55.601215 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept-Encoding: identity Sep 06 01:13:55.601215 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Connection: close Sep 06 01:13:55.601215 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Length: 74 Sep 06 01:13:55.601215 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Type: application/json Sep 06 01:13:55.601215 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Host: 10.222.0.23 Sep 06 01:13:55.601215 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Openstack-System-Scope: None Sep 06 01:13:55.601215 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Sep 06 01:13:55.601215 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjFp5NMcwKuEUHo2486ufaQ1_DZDxLGpUTLrr7cY7CHRRWjkMwkS2RH-midIYAwqOB5ZPR8PbCADD5XlDFDs-1j0nZ0VMlxZ2i03OyHDj--OqiIIDDm8dNS5bEMfqSgxwbC1vfe-w2IKMjXfHxinzodZYhHEbGdxznmqwbs3qXAmEUuhE Sep 06 01:13:55.601215 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Id: None Sep 06 01:13:55.601215 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Name: None Sep 06 01:13:55.601215 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Identity-Status: Confirmed Sep 06 01:13:55.601215 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Is-Admin-Project: True Sep 06 01:13:55.601215 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Id: default Sep 06 01:13:55.601215 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Name: Default Sep 06 01:13:55.601215 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Id: 91ee5ad0b4064b9d8a038980786072cb Sep 06 01:13:55.601215 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-317724904 Sep 06 01:13:55.601215 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Role: reader,member Sep 06 01:13:55.601215 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Roles: reader,member Sep 06 01:13:55.602751 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ee5ad0b4064b9d8a038980786072cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/91ee5ad0b4064b9d8a038980786072cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_91ee5ad0b4064b9d8a038980786072cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ee5ad0b4064b9d8a038980786072cb"}]}] Sep 06 01:13:55.602751 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant: tempest-ServerRescueNegativeTestJSON-317724904 Sep 06 01:13:55.602751 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Id: 91ee5ad0b4064b9d8a038980786072cb Sep 06 01:13:55.602751 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-317724904 Sep 06 01:13:55.602751 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User: tempest-ServerRescueNegativeTestJSON-317724904-project Sep 06 01:13:55.602751 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Id: default Sep 06 01:13:55.602751 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Name: Default Sep 06 01:13:55.602751 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Id: 703464e4a9524efaa8fdfc1870158cbb Sep 06 01:13:55.602751 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Name: tempest-ServerRescueNegativeTestJSON-317724904-project Sep 06 01:13:55.602751 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Sep 06 01:13:55.602751 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: {"volumeAttachment": {"volumeId": "0b24b6c0-cca8-47c5-8fb2-5b29f16fe13f"}} Sep 06 01:13:55.602751 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: method: > Sep 06 01:13:55.603597 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: exception: Cannot 'attach_volume' instance cf424d2a-0a95-48dc-9ee5-13fab569cb43 while it is in vm_state rescued Sep 06 01:13:55.603597 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: action_args: {'server_id': 'cf424d2a-0a95-48dc-9ee5-13fab569cb43', 'body': {'volumeAttachment': {'volumeId': '0b24b6c0-cca8-47c5-8fb2-5b29f16fe13f'}}} Sep 06 01:13:55.603597 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:13:55.603597 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:13:55.603597 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 06 01:13:55.603597 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 06 01:13:55.603597 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 01:13:55.603597 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 01:13:55.603597 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 06 01:13:55.603597 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 06 01:13:55.603597 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cf424d2a-0a95-48dc-9ee5-13fab569cb43 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 06 01:13:55.603597 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:13:55.603597 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:13:55.603597 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:13:55.603597 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:13:55.603597 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:13:55.603597 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:13:55.603597 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:13:55.603597 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:13:55.605032 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:13:55.605032 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:13:55.605032 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 01:13:55.605032 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 01:13:55.605032 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 01:13:55.605032 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 01:13:55.605032 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 01:13:55.605032 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 01:13:55.605032 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 06 01:13:55.605032 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 06 01:13:55.605032 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 06 01:13:55.605032 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 06 01:13:55.605032 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance cf424d2a-0a95-48dc-9ee5-13fab569cb43 while it is in vm_state rescued Sep 06 01:13:55.605032 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:13:55.605032 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:13:55.605032 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:13:55.605032 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:13:55.605032 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:13:55.605032 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:13:55.607219 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:13:55.607219 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:13:55.607219 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance cf424d2a-0a95-48dc-9ee5-13fab569cb43 while it is in vm_state rescued Sep 06 01:13:55.607219 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:13:55.607219 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-59537637-773b-46dd-b3c5-d6fb85bed3ec tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Returning 409 to user: Cannot 'attach_volume' instance cf424d2a-0a95-48dc-9ee5-13fab569cb43 while it is in vm_state rescued {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:13:55.607219 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-59537637-773b-46dd-b3c5-d6fb85bed3ec tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "POST /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.057880 Sep 06 01:13:55.607219 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 179/364] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Sep 6 01:13:55 2022] POST /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43/os-volume_attachments => generated 152 bytes in 62 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 06 01:13:55.611867 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-af7d5585-9fb9-4583-8a72-030d81e5abd3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:13:55.612587 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-af7d5585-9fb9-4583-8a72-030d81e5abd3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:55.615176 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.compute.server_external_events [req-7bf078b1-1ac8-4580-99fd-12f458f5a491 req-deee34fe-7f28-435d-bd44-cd921bc63627 service nova] Creating event network-vif-plugged:9f5084ac-bd14-44b7-bba5-06b59fd5291e for instance c42df4ca-a678-4b12-b5dc-3f3c0af93125 on hv-cinder-84773 Sep 06 01:13:55.618960 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-af7d5585-9fb9-4583-8a72-030d81e5abd3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:55.619961 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-af7d5585-9fb9-4583-8a72-030d81e5abd3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:55.620617 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-af7d5585-9fb9-4583-8a72-030d81e5abd3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:55.621294 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [req-7bf078b1-1ac8-4580-99fd-12f458f5a491 req-deee34fe-7f28-435d-bd44-cd921bc63627 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043527 Sep 06 01:13:55.621408 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-af7d5585-9fb9-4583-8a72-030d81e5abd3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:55.622112 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-af7d5585-9fb9-4583-8a72-030d81e5abd3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:55.622344 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 186/365] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:13:55.622545 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-af7d5585-9fb9-4583-8a72-030d81e5abd3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:55.687275 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-af7d5585-9fb9-4583-8a72-030d81e5abd3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "POST /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43/action" status: 202 len: 0 microversion: 2.1 time: 0.079099 Sep 06 01:13:55.688852 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 180/366] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Sep 6 01:13:55 2022] POST /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 01:13:55.696588 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-ea4b6f5c-6d8b-41e0-a1c2-b0386723368a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:55.697282 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-ea4b6f5c-6d8b-41e0-a1c2-b0386723368a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:55.703250 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ea4b6f5c-6d8b-41e0-a1c2-b0386723368a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:55.703721 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ea4b6f5c-6d8b-41e0-a1c2-b0386723368a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:55.704191 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ea4b6f5c-6d8b-41e0-a1c2-b0386723368a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:55.704860 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ea4b6f5c-6d8b-41e0-a1c2-b0386723368a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:55.705308 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ea4b6f5c-6d8b-41e0-a1c2-b0386723368a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:55.705723 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ea4b6f5c-6d8b-41e0-a1c2-b0386723368a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:55.845233 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-ea4b6f5c-6d8b-41e0-a1c2-b0386723368a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:55.855336 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-ea4b6f5c-6d8b-41e0-a1c2-b0386723368a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1508 microversion: 2.1 time: 0.162689 Sep 06 01:13:55.856256 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 187/367] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:55 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:56.463502 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b8b8f668-28d1-41d8-9e2f-10b3a24fe1ee tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:56.464228 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b8b8f668-28d1-41d8-9e2f-10b3a24fe1ee tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:56.470312 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8b8f668-28d1-41d8-9e2f-10b3a24fe1ee tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:56.470978 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8b8f668-28d1-41d8-9e2f-10b3a24fe1ee tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:56.471420 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8b8f668-28d1-41d8-9e2f-10b3a24fe1ee tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:56.472146 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8b8f668-28d1-41d8-9e2f-10b3a24fe1ee tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:56.472767 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8b8f668-28d1-41d8-9e2f-10b3a24fe1ee tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:56.473225 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8b8f668-28d1-41d8-9e2f-10b3a24fe1ee tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:56.566476 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-3f42d425-4fbb-4956-8993-ce5214f7b9db tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:56.567225 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-3f42d425-4fbb-4956-8993-ce5214f7b9db tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:56.573630 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3f42d425-4fbb-4956-8993-ce5214f7b9db tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:56.574351 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3f42d425-4fbb-4956-8993-ce5214f7b9db tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:56.574859 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3f42d425-4fbb-4956-8993-ce5214f7b9db tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:56.575561 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3f42d425-4fbb-4956-8993-ce5214f7b9db tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:56.576045 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3f42d425-4fbb-4956-8993-ce5214f7b9db tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:56.576471 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3f42d425-4fbb-4956-8993-ce5214f7b9db tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:56.664411 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-3f42d425-4fbb-4956-8993-ce5214f7b9db tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:56.672243 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-3f42d425-4fbb-4956-8993-ce5214f7b9db tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5" status: 200 len: 1300 microversion: 2.1 time: 0.109653 Sep 06 01:13:56.673004 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 188/368] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:56 2022] GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5 => generated 1300 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:13:56.677335 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-eef5d453-bbd2-45fe-9fae-da72ac13704f tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:56.678118 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-eef5d453-bbd2-45fe-9fae-da72ac13704f tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] [instance: ca3a12a4-8200-4090-b6ea-b41f0fdd46a6] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:56.683739 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-eef5d453-bbd2-45fe-9fae-da72ac13704f tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:56.684337 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-eef5d453-bbd2-45fe-9fae-da72ac13704f tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:56.685083 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-eef5d453-bbd2-45fe-9fae-da72ac13704f tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:56.685458 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-eef5d453-bbd2-45fe-9fae-da72ac13704f tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:56.685913 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-eef5d453-bbd2-45fe-9fae-da72ac13704f tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:56.686360 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-eef5d453-bbd2-45fe-9fae-da72ac13704f tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:56.698843 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-b8b8f668-28d1-41d8-9e2f-10b3a24fe1ee tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:56.699883 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.wsgi [None req-eef5d453-bbd2-45fe-9fae-da72ac13704f tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] HTTP exception thrown: Instance ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 could not be found. Sep 06 01:13:56.701533 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-eef5d453-bbd2-45fe-9fae-da72ac13704f tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Request method failure captured: Sep 06 01:13:56.701533 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: request: GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 HTTP/1.1 Sep 06 01:13:56.701533 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept: application/json Sep 06 01:13:56.701533 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept-Encoding: identity Sep 06 01:13:56.701533 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Connection: close Sep 06 01:13:56.701533 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Length: 0 Sep 06 01:13:56.701533 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Type: application/json Sep 06 01:13:56.701533 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Host: 10.222.0.23 Sep 06 01:13:56.701533 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Openstack-System-Scope: None Sep 06 01:13:56.701533 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: User-Agent: python-urllib3/1.26.12 Sep 06 01:13:56.701533 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Auth-Token: gAAAAABjFp6LbeL7MDdUpgnJe7S_Y7tWIvNshflAH_DTsWt8pTkMmTRgFq-_61Z93yDGdWz1AtE8dEEcq7W8sqXJq2wIeDZ_5JQEMHYRFAMW9xeXWDI1_jvvlHzEx6r62uW_XtcUMQ72fc8VeMYOiUzSamcwjeWlwKG4ibM1M0j8tzJ-r2sCAaA Sep 06 01:13:56.701533 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Id: None Sep 06 01:13:56.701533 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Name: None Sep 06 01:13:56.701533 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Identity-Status: Confirmed Sep 06 01:13:56.701533 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Is-Admin-Project: True Sep 06 01:13:56.701533 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Id: default Sep 06 01:13:56.701533 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Name: Default Sep 06 01:13:56.701533 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Id: 9ead4033c51d4658a5406c045da1c26e Sep 06 01:13:56.701533 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Name: tempest-VolumesActionsTest-86383368 Sep 06 01:13:56.701533 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Role: reader,member Sep 06 01:13:56.701533 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Roles: reader,member Sep 06 01:13:56.702736 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9ead4033c51d4658a5406c045da1c26e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9ead4033c51d4658a5406c045da1c26e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9ead4033c51d4658a5406c045da1c26e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9ead4033c51d4658a5406c045da1c26e"}]}] Sep 06 01:13:56.702736 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant: tempest-VolumesActionsTest-86383368 Sep 06 01:13:56.702736 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Id: 9ead4033c51d4658a5406c045da1c26e Sep 06 01:13:56.702736 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Name: tempest-VolumesActionsTest-86383368 Sep 06 01:13:56.702736 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User: tempest-VolumesActionsTest-86383368-project Sep 06 01:13:56.702736 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Id: default Sep 06 01:13:56.702736 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Name: Default Sep 06 01:13:56.702736 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Id: 453fa4c58743419bb29e5f01d9f78041 Sep 06 01:13:56.702736 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Name: tempest-VolumesActionsTest-86383368-project Sep 06 01:13:56.702736 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: method: > Sep 06 01:13:56.702736 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: exception: Instance ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 could not be found. Sep 06 01:13:56.702736 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: action_args: {'id': 'ca3a12a4-8200-4090-b6ea-b41f0fdd46a6'} Sep 06 01:13:56.703435 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:13:56.703435 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:13:56.703435 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 01:13:56.703435 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 01:13:56.703435 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 01:13:56.703435 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 01:13:56.703435 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 01:13:56.703435 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 01:13:56.703435 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 01:13:56.703435 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 01:13:56.703435 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 could not be found. Sep 06 01:13:56.703435 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:13:56.703435 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:13:56.703435 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:13:56.703435 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:13:56.703435 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:13:56.703435 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:13:56.703435 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:13:56.703435 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:13:56.703435 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:13:56.704719 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:13:56.704719 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 01:13:56.704719 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 01:13:56.704719 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 01:13:56.704719 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 01:13:56.704719 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 01:13:56.704719 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:13:56.704719 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 could not be found. Sep 06 01:13:56.704719 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:13:56.704719 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:13:56.704719 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:13:56.704719 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:13:56.704719 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:13:56.704719 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:13:56.704719 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:13:56.704719 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:13:56.704719 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 could not be found. Sep 06 01:13:56.704719 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:13:56.705752 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-eef5d453-bbd2-45fe-9fae-da72ac13704f tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] Returning 404 to user: Instance ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 could not be found. {{(pid=120580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:13:56.705752 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-eef5d453-bbd2-45fe-9fae-da72ac13704f tempest-VolumesActionsTest-86383368 tempest-VolumesActionsTest-86383368-project] 10.222.0.23 "GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6" status: 404 len: 111 microversion: 2.1 time: 0.029200 Sep 06 01:13:56.705752 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 189/369] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:56 2022] GET /compute/v2.1/servers/ca3a12a4-8200-4090-b6ea-b41f0fdd46a6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 01:13:56.707910 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-b8b8f668-28d1-41d8-9e2f-10b3a24fe1ee tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:56.710437 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-b8b8f668-28d1-41d8-9e2f-10b3a24fe1ee tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:56.712367 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b8b8f668-28d1-41d8-9e2f-10b3a24fe1ee tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1740 microversion: 2.20 time: 0.253693 Sep 06 01:13:56.717858 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 181/370] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:13:56 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1740 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:13:56.892263 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-06f69488-7733-4012-8bc4-8eb0d4f3901d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:56.893287 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-06f69488-7733-4012-8bc4-8eb0d4f3901d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:56.901633 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-06f69488-7733-4012-8bc4-8eb0d4f3901d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:56.902835 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-06f69488-7733-4012-8bc4-8eb0d4f3901d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:56.903566 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-06f69488-7733-4012-8bc4-8eb0d4f3901d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:56.904725 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-06f69488-7733-4012-8bc4-8eb0d4f3901d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:56.905763 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-06f69488-7733-4012-8bc4-8eb0d4f3901d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:56.906399 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-06f69488-7733-4012-8bc4-8eb0d4f3901d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:57.267191 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-06f69488-7733-4012-8bc4-8eb0d4f3901d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:57.276131 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-06f69488-7733-4012-8bc4-8eb0d4f3901d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1508 microversion: 2.1 time: 0.391364 Sep 06 01:13:57.277057 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 190/371] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:56 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1508 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:57.696050 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-eceacaa6-23f7-49dd-9195-957a81dda411 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:57.696697 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-eceacaa6-23f7-49dd-9195-957a81dda411 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:57.703032 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eceacaa6-23f7-49dd-9195-957a81dda411 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:57.703520 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eceacaa6-23f7-49dd-9195-957a81dda411 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:57.704007 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eceacaa6-23f7-49dd-9195-957a81dda411 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:57.704737 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eceacaa6-23f7-49dd-9195-957a81dda411 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:57.705223 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eceacaa6-23f7-49dd-9195-957a81dda411 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:57.705673 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eceacaa6-23f7-49dd-9195-957a81dda411 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:57.751049 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-fa7acfd1-2fc5-4903-bd85-3e4fa27eba17 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:57.751873 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-fa7acfd1-2fc5-4903-bd85-3e4fa27eba17 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:57.760576 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fa7acfd1-2fc5-4903-bd85-3e4fa27eba17 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:57.761396 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fa7acfd1-2fc5-4903-bd85-3e4fa27eba17 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:57.762486 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fa7acfd1-2fc5-4903-bd85-3e4fa27eba17 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:57.763274 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fa7acfd1-2fc5-4903-bd85-3e4fa27eba17 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:57.763780 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fa7acfd1-2fc5-4903-bd85-3e4fa27eba17 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:57.764748 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fa7acfd1-2fc5-4903-bd85-3e4fa27eba17 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:57.903220 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-eceacaa6-23f7-49dd-9195-957a81dda411 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:57.913266 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-eceacaa6-23f7-49dd-9195-957a81dda411 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5" status: 200 len: 1368 microversion: 2.1 time: 0.221458 Sep 06 01:13:57.914423 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 182/372] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:57 2022] GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5 => generated 1368 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:57.947191 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-fa7acfd1-2fc5-4903-bd85-3e4fa27eba17 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:57.955708 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-fa7acfd1-2fc5-4903-bd85-3e4fa27eba17 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:57.957168 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-fa7acfd1-2fc5-4903-bd85-3e4fa27eba17 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:57.958325 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-fa7acfd1-2fc5-4903-bd85-3e4fa27eba17 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1740 microversion: 2.20 time: 0.223843 Sep 06 01:13:57.959504 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 191/373] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:13:57 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1740 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:13:58.302131 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c24c9323-495b-419a-a63d-389bca440a51 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:58.303326 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c24c9323-495b-419a-a63d-389bca440a51 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:58.309718 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c24c9323-495b-419a-a63d-389bca440a51 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:58.310209 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c24c9323-495b-419a-a63d-389bca440a51 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:58.310780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c24c9323-495b-419a-a63d-389bca440a51 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:58.311335 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c24c9323-495b-419a-a63d-389bca440a51 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:58.311815 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c24c9323-495b-419a-a63d-389bca440a51 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:58.312243 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c24c9323-495b-419a-a63d-389bca440a51 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:58.449289 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-c24c9323-495b-419a-a63d-389bca440a51 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:58.460803 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c24c9323-495b-419a-a63d-389bca440a51 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1508 microversion: 2.1 time: 0.162927 Sep 06 01:13:58.461640 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 183/374] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:58 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:58.936301 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-81362373-299d-490f-afe5-1edde156ee08 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:58.936919 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-81362373-299d-490f-afe5-1edde156ee08 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:58.943444 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-81362373-299d-490f-afe5-1edde156ee08 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:58.944005 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-81362373-299d-490f-afe5-1edde156ee08 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:58.944446 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-81362373-299d-490f-afe5-1edde156ee08 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:58.945142 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-81362373-299d-490f-afe5-1edde156ee08 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:58.945591 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-81362373-299d-490f-afe5-1edde156ee08 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:58.946015 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-81362373-299d-490f-afe5-1edde156ee08 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:58.983835 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-765dfe2f-f02b-4ac9-a3af-5507f3c67c9d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:58.984443 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-765dfe2f-f02b-4ac9-a3af-5507f3c67c9d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:58.990907 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-765dfe2f-f02b-4ac9-a3af-5507f3c67c9d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:58.991394 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-765dfe2f-f02b-4ac9-a3af-5507f3c67c9d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:58.991852 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-765dfe2f-f02b-4ac9-a3af-5507f3c67c9d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:58.992549 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-765dfe2f-f02b-4ac9-a3af-5507f3c67c9d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:58.992998 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-765dfe2f-f02b-4ac9-a3af-5507f3c67c9d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:58.993421 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-765dfe2f-f02b-4ac9-a3af-5507f3c67c9d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:59.120892 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-81362373-299d-490f-afe5-1edde156ee08 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:59.129278 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-81362373-299d-490f-afe5-1edde156ee08 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5" status: 200 len: 1368 microversion: 2.1 time: 0.196762 Sep 06 01:13:59.129918 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 192/375] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:58 2022] GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5 => generated 1368 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:59.158035 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-765dfe2f-f02b-4ac9-a3af-5507f3c67c9d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:59.167447 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-765dfe2f-f02b-4ac9-a3af-5507f3c67c9d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:59.169401 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-765dfe2f-f02b-4ac9-a3af-5507f3c67c9d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:59.170936 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-765dfe2f-f02b-4ac9-a3af-5507f3c67c9d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1740 microversion: 2.20 time: 0.190755 Sep 06 01:13:59.171651 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 184/376] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:13:58 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:13:59.489784 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-6291bac1-089a-41c0-bccc-0155c7a344de tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:13:59.490423 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-6291bac1-089a-41c0-bccc-0155c7a344de tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:13:59.498116 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6291bac1-089a-41c0-bccc-0155c7a344de tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:59.499086 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6291bac1-089a-41c0-bccc-0155c7a344de tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:59.499806 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6291bac1-089a-41c0-bccc-0155c7a344de tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:59.500550 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6291bac1-089a-41c0-bccc-0155c7a344de tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:59.501268 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6291bac1-089a-41c0-bccc-0155c7a344de tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:59.501524 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6291bac1-089a-41c0-bccc-0155c7a344de tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:59.752344 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-6291bac1-089a-41c0-bccc-0155c7a344de tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:13:59.760688 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-6291bac1-089a-41c0-bccc-0155c7a344de tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1508 microversion: 2.1 time: 0.275054 Sep 06 01:13:59.761247 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 193/377] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:13:59 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1508 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:13:59.931467 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-f4aa2444-b689-4580-98c5-b84268975d72 req-97d3255d-8b5c-4666-8d63-843be94715fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9a2a405-dce3-4320-b44d-a19c556501b5", "tag": "1d34bce1-fa87-41f6-98ae-7a1f148c1081"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:13:59.943530 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-f4aa2444-b689-4580-98c5-b84268975d72 req-97d3255d-8b5c-4666-8d63-843be94715fc service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:13:59.943995 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-f4aa2444-b689-4580-98c5-b84268975d72 req-97d3255d-8b5c-4666-8d63-843be94715fc service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:13:59.944468 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-f4aa2444-b689-4580-98c5-b84268975d72 req-97d3255d-8b5c-4666-8d63-843be94715fc service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:13:59.959456 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-f4aa2444-b689-4580-98c5-b84268975d72 req-97d3255d-8b5c-4666-8d63-843be94715fc service nova] Creating event network-changed:1d34bce1-fa87-41f6-98ae-7a1f148c1081 for instance f9a2a405-dce3-4320-b44d-a19c556501b5 on hv-cinder-84773 Sep 06 01:13:59.966249 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-f4aa2444-b689-4580-98c5-b84268975d72 req-97d3255d-8b5c-4666-8d63-843be94715fc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040519 Sep 06 01:13:59.967559 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 185/378] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:14:00.152493 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-1a9029f0-da2f-4b0b-869a-7809d92da3e8 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:00.153902 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-1a9029f0-da2f-4b0b-869a-7809d92da3e8 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:00.156597 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:00.164064 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1a9029f0-da2f-4b0b-869a-7809d92da3e8 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:00.164750 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1a9029f0-da2f-4b0b-869a-7809d92da3e8 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:00.165198 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1a9029f0-da2f-4b0b-869a-7809d92da3e8 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:00.170358 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1a9029f0-da2f-4b0b-869a-7809d92da3e8 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:00.170850 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1a9029f0-da2f-4b0b-869a-7809d92da3e8 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:00.171272 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1a9029f0-da2f-4b0b-869a-7809d92da3e8 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:00.199881 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-76821d15-4ad0-47e9-aeb3-615b8caf07a5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:00.208797 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-76821d15-4ad0-47e9-aeb3-615b8caf07a5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:00.219685 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-76821d15-4ad0-47e9-aeb3-615b8caf07a5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:00.220407 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-76821d15-4ad0-47e9-aeb3-615b8caf07a5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:00.221075 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-76821d15-4ad0-47e9-aeb3-615b8caf07a5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:00.222005 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-76821d15-4ad0-47e9-aeb3-615b8caf07a5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:00.222667 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-76821d15-4ad0-47e9-aeb3-615b8caf07a5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:00.223297 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-76821d15-4ad0-47e9-aeb3-615b8caf07a5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:00.246722 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:00.454970 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-1a9029f0-da2f-4b0b-869a-7809d92da3e8 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:00.468178 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-76821d15-4ad0-47e9-aeb3-615b8caf07a5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:00.474229 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-1a9029f0-da2f-4b0b-869a-7809d92da3e8 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5" status: 200 len: 1368 microversion: 2.1 time: 0.325301 Sep 06 01:14:00.476088 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 194/379] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:00 2022] GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5 => generated 1368 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:00.487365 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-76821d15-4ad0-47e9-aeb3-615b8caf07a5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:00.489153 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-76821d15-4ad0-47e9-aeb3-615b8caf07a5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:00.490527 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-76821d15-4ad0-47e9-aeb3-615b8caf07a5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1740 microversion: 2.20 time: 0.295452 Sep 06 01:14:00.491510 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 186/380] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:14:00 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1740 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:14:00.796639 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-5fbc68f0-0b18-446b-99da-d2c3c299c4f9 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:00.797570 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-5fbc68f0-0b18-446b-99da-d2c3c299c4f9 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:00.804469 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5fbc68f0-0b18-446b-99da-d2c3c299c4f9 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:00.805253 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5fbc68f0-0b18-446b-99da-d2c3c299c4f9 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:00.805925 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5fbc68f0-0b18-446b-99da-d2c3c299c4f9 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:00.806839 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5fbc68f0-0b18-446b-99da-d2c3c299c4f9 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:00.807504 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5fbc68f0-0b18-446b-99da-d2c3c299c4f9 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:00.808191 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5fbc68f0-0b18-446b-99da-d2c3c299c4f9 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:00.944960 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-5fbc68f0-0b18-446b-99da-d2c3c299c4f9 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:00.952743 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-5fbc68f0-0b18-446b-99da-d2c3c299c4f9 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1508 microversion: 2.1 time: 0.173275 Sep 06 01:14:00.953384 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 195/381] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:00 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1508 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:01.498485 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1d81cc11-6b6d-4fc2-980c-6ca3cba1b53f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:01.499971 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1d81cc11-6b6d-4fc2-980c-6ca3cba1b53f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:01.507238 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d81cc11-6b6d-4fc2-980c-6ca3cba1b53f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:01.507951 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d81cc11-6b6d-4fc2-980c-6ca3cba1b53f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:01.508388 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d81cc11-6b6d-4fc2-980c-6ca3cba1b53f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:01.509370 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d81cc11-6b6d-4fc2-980c-6ca3cba1b53f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:01.509987 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d81cc11-6b6d-4fc2-980c-6ca3cba1b53f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:01.510599 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d81cc11-6b6d-4fc2-980c-6ca3cba1b53f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:01.521340 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-eef77759-41ab-49ee-ac02-8cafb3d14e9c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:01.522308 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-eef77759-41ab-49ee-ac02-8cafb3d14e9c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:01.539715 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-eef77759-41ab-49ee-ac02-8cafb3d14e9c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:01.540228 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-eef77759-41ab-49ee-ac02-8cafb3d14e9c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:01.540668 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-eef77759-41ab-49ee-ac02-8cafb3d14e9c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:01.541372 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-eef77759-41ab-49ee-ac02-8cafb3d14e9c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:01.541832 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-eef77759-41ab-49ee-ac02-8cafb3d14e9c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:01.542262 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-eef77759-41ab-49ee-ac02-8cafb3d14e9c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:01.827792 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-eef77759-41ab-49ee-ac02-8cafb3d14e9c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:01.836304 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-eef77759-41ab-49ee-ac02-8cafb3d14e9c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:01.837679 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-eef77759-41ab-49ee-ac02-8cafb3d14e9c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:01.838856 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-eef77759-41ab-49ee-ac02-8cafb3d14e9c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1740 microversion: 2.20 time: 0.321953 Sep 06 01:14:01.839408 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 196/382] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:14:01 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1740 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:14:01.871266 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-1d81cc11-6b6d-4fc2-980c-6ca3cba1b53f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:01.884892 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1d81cc11-6b6d-4fc2-980c-6ca3cba1b53f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5" status: 200 len: 1368 microversion: 2.1 time: 0.390497 Sep 06 01:14:01.885468 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 187/383] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:01 2022] GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5 => generated 1368 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:01.977058 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-1f673138-9854-4d08-a135-6a765e7b7d12 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:01.978201 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-1f673138-9854-4d08-a135-6a765e7b7d12 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:01.984161 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1f673138-9854-4d08-a135-6a765e7b7d12 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:01.984878 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1f673138-9854-4d08-a135-6a765e7b7d12 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:01.985319 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1f673138-9854-4d08-a135-6a765e7b7d12 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:01.986015 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1f673138-9854-4d08-a135-6a765e7b7d12 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:01.986628 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1f673138-9854-4d08-a135-6a765e7b7d12 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:01.987220 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1f673138-9854-4d08-a135-6a765e7b7d12 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:02.155220 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-1f673138-9854-4d08-a135-6a765e7b7d12 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:02.163496 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-1f673138-9854-4d08-a135-6a765e7b7d12 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1508 microversion: 2.1 time: 0.190240 Sep 06 01:14:02.164508 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 197/384] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:01 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1508 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:02.866573 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9669396f-09f0-4c52-a0c0-11b71002ca26 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:02.868329 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9669396f-09f0-4c52-a0c0-11b71002ca26 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:02.875308 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9669396f-09f0-4c52-a0c0-11b71002ca26 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:02.876174 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9669396f-09f0-4c52-a0c0-11b71002ca26 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:02.876784 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9669396f-09f0-4c52-a0c0-11b71002ca26 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:02.877673 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9669396f-09f0-4c52-a0c0-11b71002ca26 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:02.878134 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9669396f-09f0-4c52-a0c0-11b71002ca26 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:02.878564 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9669396f-09f0-4c52-a0c0-11b71002ca26 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:02.908204 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-d2ce8878-2727-4708-9146-a7239d0b2111 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:02.909526 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-d2ce8878-2727-4708-9146-a7239d0b2111 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:02.917086 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d2ce8878-2727-4708-9146-a7239d0b2111 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:02.918262 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d2ce8878-2727-4708-9146-a7239d0b2111 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:02.918904 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d2ce8878-2727-4708-9146-a7239d0b2111 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:02.919662 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d2ce8878-2727-4708-9146-a7239d0b2111 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:02.920400 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d2ce8878-2727-4708-9146-a7239d0b2111 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:02.920892 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d2ce8878-2727-4708-9146-a7239d0b2111 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:03.072327 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-9669396f-09f0-4c52-a0c0-11b71002ca26 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:03.088881 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-9669396f-09f0-4c52-a0c0-11b71002ca26 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:03.090886 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-9669396f-09f0-4c52-a0c0-11b71002ca26 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:03.093362 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9669396f-09f0-4c52-a0c0-11b71002ca26 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1740 microversion: 2.20 time: 0.231543 Sep 06 01:14:03.105072 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 188/385] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:14:02 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1740 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:14:03.118358 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-d2ce8878-2727-4708-9146-a7239d0b2111 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:03.127869 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-d2ce8878-2727-4708-9146-a7239d0b2111 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5" status: 200 len: 1368 microversion: 2.1 time: 0.223815 Sep 06 01:14:03.128485 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 198/386] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:02 2022] GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5 => generated 1368 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:03.188315 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c4ff5fe5-4ea8-444f-8309-ba43b757b1ee tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:03.189262 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c4ff5fe5-4ea8-444f-8309-ba43b757b1ee tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:03.191268 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:03.198417 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c4ff5fe5-4ea8-444f-8309-ba43b757b1ee tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:03.198901 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c4ff5fe5-4ea8-444f-8309-ba43b757b1ee tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:03.199339 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c4ff5fe5-4ea8-444f-8309-ba43b757b1ee tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:03.200166 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c4ff5fe5-4ea8-444f-8309-ba43b757b1ee tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:03.200924 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c4ff5fe5-4ea8-444f-8309-ba43b757b1ee tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:03.201501 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c4ff5fe5-4ea8-444f-8309-ba43b757b1ee tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:03.364301 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-c4ff5fe5-4ea8-444f-8309-ba43b757b1ee tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:03.376222 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c4ff5fe5-4ea8-444f-8309-ba43b757b1ee tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1508 microversion: 2.1 time: 0.191974 Sep 06 01:14:03.376989 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 189/387] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:03 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1508 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:04.121829 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-997d3740-e505-4daa-aa4a-52bc9289088d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:04.123312 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-997d3740-e505-4daa-aa4a-52bc9289088d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:04.134746 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-997d3740-e505-4daa-aa4a-52bc9289088d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:04.135248 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-997d3740-e505-4daa-aa4a-52bc9289088d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:04.135695 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-997d3740-e505-4daa-aa4a-52bc9289088d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:04.136441 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-997d3740-e505-4daa-aa4a-52bc9289088d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:04.136897 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-997d3740-e505-4daa-aa4a-52bc9289088d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:04.137509 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-997d3740-e505-4daa-aa4a-52bc9289088d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:04.156573 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c47dbb2f-f873-4ea0-8c6d-d0f022c0ba14 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:04.157860 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c47dbb2f-f873-4ea0-8c6d-d0f022c0ba14 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:04.168285 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c47dbb2f-f873-4ea0-8c6d-d0f022c0ba14 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:04.169517 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c47dbb2f-f873-4ea0-8c6d-d0f022c0ba14 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:04.170650 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c47dbb2f-f873-4ea0-8c6d-d0f022c0ba14 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:04.171615 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c47dbb2f-f873-4ea0-8c6d-d0f022c0ba14 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:04.172166 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c47dbb2f-f873-4ea0-8c6d-d0f022c0ba14 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:04.172754 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c47dbb2f-f873-4ea0-8c6d-d0f022c0ba14 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:04.535576 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-997d3740-e505-4daa-aa4a-52bc9289088d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:04.553143 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-997d3740-e505-4daa-aa4a-52bc9289088d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:04.554960 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-997d3740-e505-4daa-aa4a-52bc9289088d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:04.558028 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-997d3740-e505-4daa-aa4a-52bc9289088d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1740 microversion: 2.20 time: 0.441183 Sep 06 01:14:04.558935 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 199/388] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:14:04 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1740 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:14:04.576115 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-bb84b127-14b9-4e2e-9286-7e60d91975cb tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:04.577300 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-bb84b127-14b9-4e2e-9286-7e60d91975cb tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:04.586778 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-bb84b127-14b9-4e2e-9286-7e60d91975cb tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:04.590846 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-bb84b127-14b9-4e2e-9286-7e60d91975cb tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:04.591414 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-bb84b127-14b9-4e2e-9286-7e60d91975cb tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:04.592308 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-bb84b127-14b9-4e2e-9286-7e60d91975cb tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:04.592903 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-bb84b127-14b9-4e2e-9286-7e60d91975cb tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:04.593439 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-bb84b127-14b9-4e2e-9286-7e60d91975cb tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:04.607251 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-c47dbb2f-f873-4ea0-8c6d-d0f022c0ba14 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:04.618341 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c47dbb2f-f873-4ea0-8c6d-d0f022c0ba14 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5" status: 200 len: 1368 microversion: 2.1 time: 0.465664 Sep 06 01:14:04.618947 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 190/389] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:04 2022] GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5 => generated 1368 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:04.967302 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-bb84b127-14b9-4e2e-9286-7e60d91975cb tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:04.983020 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-bb84b127-14b9-4e2e-9286-7e60d91975cb tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1508 microversion: 2.1 time: 0.422786 Sep 06 01:14:04.998344 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 200/390] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:04 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1508 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:05.588752 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d2eda50d-d59b-4240-a328-707741a87e26 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:05.590033 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d2eda50d-d59b-4240-a328-707741a87e26 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:05.601849 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d2eda50d-d59b-4240-a328-707741a87e26 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:05.603621 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d2eda50d-d59b-4240-a328-707741a87e26 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:05.604101 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d2eda50d-d59b-4240-a328-707741a87e26 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:05.607097 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d2eda50d-d59b-4240-a328-707741a87e26 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:05.607632 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d2eda50d-d59b-4240-a328-707741a87e26 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:05.609583 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d2eda50d-d59b-4240-a328-707741a87e26 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:05.647572 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-2ea2a63d-eddf-4444-a5af-83d15d39e0ae tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:05.648955 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-2ea2a63d-eddf-4444-a5af-83d15d39e0ae tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:05.661352 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2ea2a63d-eddf-4444-a5af-83d15d39e0ae tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:05.663307 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2ea2a63d-eddf-4444-a5af-83d15d39e0ae tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:05.664252 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2ea2a63d-eddf-4444-a5af-83d15d39e0ae tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:05.666393 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2ea2a63d-eddf-4444-a5af-83d15d39e0ae tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:05.667173 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2ea2a63d-eddf-4444-a5af-83d15d39e0ae tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:05.668217 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2ea2a63d-eddf-4444-a5af-83d15d39e0ae tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:05.675185 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell1:SELECT=100 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:06.026400 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-2ea2a63d-eddf-4444-a5af-83d15d39e0ae tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:06.034268 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-2ea2a63d-eddf-4444-a5af-83d15d39e0ae tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5" status: 200 len: 1368 microversion: 2.1 time: 0.392467 Sep 06 01:14:06.038234 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 201/391] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:05 2022] GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5 => generated 1368 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:14:06.042863 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-d2eda50d-d59b-4240-a328-707741a87e26 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:06.055799 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-d55c075e-8841-4441-b004-cf12fa88d730 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:06.056548 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-d55c075e-8841-4441-b004-cf12fa88d730 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 7589d872-fdde-4504-b16e-1f16598c41d3] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:06.060765 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-d2eda50d-d59b-4240-a328-707741a87e26 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:06.062673 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-d2eda50d-d59b-4240-a328-707741a87e26 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:06.064144 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d2eda50d-d59b-4240-a328-707741a87e26 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1740 microversion: 2.20 time: 0.479676 Sep 06 01:14:06.065541 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 191/392] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:14:05 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1740 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:14:06.071913 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e216440f-c986-4ff3-8680-02cc60b235d6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:06.072538 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e216440f-c986-4ff3-8680-02cc60b235d6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:06.080742 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d55c075e-8841-4441-b004-cf12fa88d730 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:06.084777 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d55c075e-8841-4441-b004-cf12fa88d730 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:06.087583 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d55c075e-8841-4441-b004-cf12fa88d730 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:06.088406 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d55c075e-8841-4441-b004-cf12fa88d730 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:06.088876 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d55c075e-8841-4441-b004-cf12fa88d730 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:06.089308 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d55c075e-8841-4441-b004-cf12fa88d730 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:06.100351 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e216440f-c986-4ff3-8680-02cc60b235d6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:06.100861 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e216440f-c986-4ff3-8680-02cc60b235d6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:06.102530 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e216440f-c986-4ff3-8680-02cc60b235d6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:06.105838 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e216440f-c986-4ff3-8680-02cc60b235d6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:06.106313 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e216440f-c986-4ff3-8680-02cc60b235d6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:06.106752 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e216440f-c986-4ff3-8680-02cc60b235d6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:06.353846 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.objects.instance [None req-d55c075e-8841-4441-b004-cf12fa88d730 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lazy-loading 'services' on Instance uuid 7589d872-fdde-4504-b16e-1f16598c41d3 {{(pid=120580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 01:14:06.625716 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-d55c075e-8841-4441-b004-cf12fa88d730 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7589d872-fdde-4504-b16e-1f16598c41d3/os-volume_attachments/f2a8a28f-117f-4bcb-b1f6-e0f5341762b0" status: 202 len: 0 microversion: 2.1 time: 0.586054 Sep 06 01:14:06.629624 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 202/393] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Sep 6 01:14:06 2022] DELETE /compute/v2.1/servers/7589d872-fdde-4504-b16e-1f16598c41d3/os-volume_attachments/f2a8a28f-117f-4bcb-b1f6-e0f5341762b0 => generated 0 bytes in 589 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 01:14:06.906078 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-e216440f-c986-4ff3-8680-02cc60b235d6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:06.914167 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e216440f-c986-4ff3-8680-02cc60b235d6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1514 microversion: 2.1 time: 0.847464 Sep 06 01:14:06.937771 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 192/394] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:06 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1514 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:07.062902 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-8f206a20-5502-483a-a862-dddde58ffd5c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:07.063611 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-8f206a20-5502-483a-a862-dddde58ffd5c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:07.075461 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8f206a20-5502-483a-a862-dddde58ffd5c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:07.076088 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8f206a20-5502-483a-a862-dddde58ffd5c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:07.076527 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8f206a20-5502-483a-a862-dddde58ffd5c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:07.077258 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8f206a20-5502-483a-a862-dddde58ffd5c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:07.080240 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8f206a20-5502-483a-a862-dddde58ffd5c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:07.080728 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8f206a20-5502-483a-a862-dddde58ffd5c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:07.094525 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-54e81d13-770d-40b4-a5b8-91144d17fe3c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:07.095140 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-54e81d13-770d-40b4-a5b8-91144d17fe3c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:07.123999 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-54e81d13-770d-40b4-a5b8-91144d17fe3c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:07.124562 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-54e81d13-770d-40b4-a5b8-91144d17fe3c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:07.128968 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-54e81d13-770d-40b4-a5b8-91144d17fe3c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:07.131032 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-54e81d13-770d-40b4-a5b8-91144d17fe3c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:07.134352 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-54e81d13-770d-40b4-a5b8-91144d17fe3c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:07.137541 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-54e81d13-770d-40b4-a5b8-91144d17fe3c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:07.718572 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-8f206a20-5502-483a-a862-dddde58ffd5c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:07.740674 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-8f206a20-5502-483a-a862-dddde58ffd5c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5" status: 200 len: 1368 microversion: 2.1 time: 0.681639 Sep 06 01:14:07.741473 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 203/395] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:07 2022] GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5 => generated 1368 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:07.890703 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-54e81d13-770d-40b4-a5b8-91144d17fe3c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:07.900048 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-54e81d13-770d-40b4-a5b8-91144d17fe3c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:07.907536 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-54e81d13-770d-40b4-a5b8-91144d17fe3c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:07.911386 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-54e81d13-770d-40b4-a5b8-91144d17fe3c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1740 microversion: 2.20 time: 0.820137 Sep 06 01:14:07.922328 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 193/396] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:14:07 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1740 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:14:08.703083 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-91046718-14b2-40aa-9630-05bc282f9234 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Action: 'create', calling method: .version_select at 0x7fb06f5dfa60>, body: {"keypair": {"name": "tempest-keypair-2119531536", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHifwzdm0MDVgPx4stHeLxkr68Ts+1RL6iYoD7qyxE+S0Sjs428BaG1yqeQrnGPaEarFNGkmFtHdoHnDdPCWCKr+0WaxuJsrLSgb3orRNIWGrxZoyJLQsU8CFOEkUuJjtA=="}} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:14:08.741970 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.quota [None req-91046718-14b2-40aa-9630-05bc282f9234 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Getting quotas for project 91ee5ad0b4064b9d8a038980786072cb. Resources: {'key_pairs'} {{(pid=120580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 01:14:08.749322 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.quota [None req-91046718-14b2-40aa-9630-05bc282f9234 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Getting quotas for user 703464e4a9524efaa8fdfc1870158cbb and project 91ee5ad0b4064b9d8a038980786072cb. Resources: {'key_pairs'} {{(pid=120580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 01:14:08.780372 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c95ac5fb-ff3a-4056-8ec1-2bb242ca309b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:08.781412 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c95ac5fb-ff3a-4056-8ec1-2bb242ca309b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:08.795037 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c95ac5fb-ff3a-4056-8ec1-2bb242ca309b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:08.798799 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c95ac5fb-ff3a-4056-8ec1-2bb242ca309b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:08.800702 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c95ac5fb-ff3a-4056-8ec1-2bb242ca309b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:08.803197 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c95ac5fb-ff3a-4056-8ec1-2bb242ca309b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:08.804200 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c95ac5fb-ff3a-4056-8ec1-2bb242ca309b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:08.804805 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c95ac5fb-ff3a-4056-8ec1-2bb242ca309b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:08.856486 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-91046718-14b2-40aa-9630-05bc282f9234 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.158893 Sep 06 01:14:08.871139 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 204/397] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Sep 6 01:14:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:14:08.949174 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-cac83f51-ebec-4209-ae5e-4ddf38bd9fa5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:08.950158 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-cac83f51-ebec-4209-ae5e-4ddf38bd9fa5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:08.963090 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cac83f51-ebec-4209-ae5e-4ddf38bd9fa5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:08.969061 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cac83f51-ebec-4209-ae5e-4ddf38bd9fa5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:08.973115 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cac83f51-ebec-4209-ae5e-4ddf38bd9fa5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:08.976288 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cac83f51-ebec-4209-ae5e-4ddf38bd9fa5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:08.982403 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cac83f51-ebec-4209-ae5e-4ddf38bd9fa5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:08.983148 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cac83f51-ebec-4209-ae5e-4ddf38bd9fa5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:09.519878 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-c95ac5fb-ff3a-4056-8ec1-2bb242ca309b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:09.534319 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c95ac5fb-ff3a-4056-8ec1-2bb242ca309b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5" status: 200 len: 1368 microversion: 2.1 time: 0.767275 Sep 06 01:14:09.549866 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 194/398] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:08 2022] GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5 => generated 1368 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:09.765921 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-cac83f51-ebec-4209-ae5e-4ddf38bd9fa5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:09.787039 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-cac83f51-ebec-4209-ae5e-4ddf38bd9fa5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:09.792280 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-cac83f51-ebec-4209-ae5e-4ddf38bd9fa5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:09.794468 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-cac83f51-ebec-4209-ae5e-4ddf38bd9fa5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1740 microversion: 2.20 time: 0.852871 Sep 06 01:14:09.799203 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 205/399] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:14:08 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1740 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:14:10.563551 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-beb066c3-8ce0-410a-865e-433ad7c698c6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:10.564232 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-beb066c3-8ce0-410a-865e-433ad7c698c6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:10.579022 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-beb066c3-8ce0-410a-865e-433ad7c698c6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:10.589047 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-beb066c3-8ce0-410a-865e-433ad7c698c6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:10.590215 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-beb066c3-8ce0-410a-865e-433ad7c698c6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:10.592008 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-beb066c3-8ce0-410a-865e-433ad7c698c6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:10.592492 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-beb066c3-8ce0-410a-865e-433ad7c698c6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:10.593027 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-beb066c3-8ce0-410a-865e-433ad7c698c6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:10.837074 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-d2e6bfe0-8b45-4971-a072-7584bbac9703 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:10.838522 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-d2e6bfe0-8b45-4971-a072-7584bbac9703 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:10.901246 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d2e6bfe0-8b45-4971-a072-7584bbac9703 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:10.901763 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d2e6bfe0-8b45-4971-a072-7584bbac9703 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:10.903455 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d2e6bfe0-8b45-4971-a072-7584bbac9703 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:10.905427 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d2e6bfe0-8b45-4971-a072-7584bbac9703 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:10.913953 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d2e6bfe0-8b45-4971-a072-7584bbac9703 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:10.915162 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d2e6bfe0-8b45-4971-a072-7584bbac9703 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:11.098713 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-beb066c3-8ce0-410a-865e-433ad7c698c6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:11.111799 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-beb066c3-8ce0-410a-865e-433ad7c698c6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5" status: 200 len: 1368 microversion: 2.1 time: 0.551451 Sep 06 01:14:11.122243 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 195/400] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:10 2022] GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5 => generated 1368 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:11.202927 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-d2e6bfe0-8b45-4971-a072-7584bbac9703 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:11.212801 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-d2e6bfe0-8b45-4971-a072-7584bbac9703 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:11.226263 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-d2e6bfe0-8b45-4971-a072-7584bbac9703 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:11.227990 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-d2e6bfe0-8b45-4971-a072-7584bbac9703 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1740 microversion: 2.20 time: 0.401192 Sep 06 01:14:11.229159 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 206/401] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:14:10 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1740 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:14:12.138247 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6e016fd9-97bd-4c5b-b8c2-4899749cee6e tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-575979728", "imageRef": "768973cc-7b5f-4eed-b493-e40eb0de9f88", "flavorRef": "452"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:14:12.142774 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-ad9d24b4-fa47-4e09-9c21-c6c7645a9d72 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:12.143399 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-ad9d24b4-fa47-4e09-9c21-c6c7645a9d72 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:12.166036 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ad9d24b4-fa47-4e09-9c21-c6c7645a9d72 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:12.166571 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ad9d24b4-fa47-4e09-9c21-c6c7645a9d72 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:12.187788 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ad9d24b4-fa47-4e09-9c21-c6c7645a9d72 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:12.188739 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ad9d24b4-fa47-4e09-9c21-c6c7645a9d72 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:12.189222 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ad9d24b4-fa47-4e09-9c21-c6c7645a9d72 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:12.189656 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ad9d24b4-fa47-4e09-9c21-c6c7645a9d72 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:12.382883 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-ad9d24b4-fa47-4e09-9c21-c6c7645a9d72 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:12.395462 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-ad9d24b4-fa47-4e09-9c21-c6c7645a9d72 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5" status: 200 len: 1368 microversion: 2.1 time: 0.262214 Sep 06 01:14:12.396860 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 207/402] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:12 2022] GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5 => generated 1368 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:12.417763 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-27ee9271-66ed-4a87-9736-3ce257683f42 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1430086542", "imageRef": "768973cc-7b5f-4eed-b493-e40eb0de9f88", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d22ca9da-097a-4693-98a0-43d03128776e"}], "security_groups": [{"name": "tempest-securitygroup--1094901533"}], "key_name": "tempest-keypair-2119531536", "user_data": "}} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:14:12.721008 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-6e016fd9-97bd-4c5b-b8c2-4899749cee6e tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] validate_networks() for None {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 01:14:12.899794 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.network.neutron [None req-27ee9271-66ed-4a87-9736-3ce257683f42 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] validate_networks() for [('d22ca9da-097a-4693-98a0-43d03128776e', None, None, None, None, None)] {{(pid=120580) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 01:14:13.141587 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-6e016fd9-97bd-4c5b-b8c2-4899749cee6e tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 01:14:13.142553 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-6e016fd9-97bd-4c5b-b8c2-4899749cee6e tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 01:14:13.143255 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-6e016fd9-97bd-4c5b-b8c2-4899749cee6e tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 01:14:13.143936 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-6e016fd9-97bd-4c5b-b8c2-4899749cee6e tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 01:14:13.144608 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-6e016fd9-97bd-4c5b-b8c2-4899749cee6e tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 01:14:13.161547 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e016fd9-97bd-4c5b-b8c2-4899749cee6e tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:13.162456 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e016fd9-97bd-4c5b-b8c2-4899749cee6e tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:13.163097 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e016fd9-97bd-4c5b-b8c2-4899749cee6e tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:13.164056 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e016fd9-97bd-4c5b-b8c2-4899749cee6e tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:13.164793 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e016fd9-97bd-4c5b-b8c2-4899749cee6e tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:13.165452 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e016fd9-97bd-4c5b-b8c2-4899749cee6e tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:13.185240 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.quota [None req-6e016fd9-97bd-4c5b-b8c2-4899749cee6e tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Getting quotas for project cffd22b3b78f416ab10fd92ac92a5589. Resources: {'instances', 'ram', 'cores'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 01:14:13.191234 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.quota [None req-6e016fd9-97bd-4c5b-b8c2-4899749cee6e tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Getting quotas for user f67c48bdc1644230a97a6d9b8fe8f9f3 and project cffd22b3b78f416ab10fd92ac92a5589. Resources: {'instances', 'ram', 'cores'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 01:14:13.206331 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6e016fd9-97bd-4c5b-b8c2-4899749cee6e tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 01:14:13.209318 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6e016fd9-97bd-4c5b-b8c2-4899749cee6e tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] [instance: dff4f970-9216-4d56-81d9-f62b12ebccff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='768973cc-7b5f-4eed-b493-e40eb0de9f88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 01:14:13.277099 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6e016fd9-97bd-4c5b-b8c2-4899749cee6e tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.147066 Sep 06 01:14:13.285624 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 196/403] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Sep 6 01:14:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1156 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 01:14:13.293199 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b02cc17c-9981-4b05-baa1-b88f5735fd8c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:13.294163 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b02cc17c-9981-4b05-baa1-b88f5735fd8c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:13.302847 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b02cc17c-9981-4b05-baa1-b88f5735fd8c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:13.303792 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b02cc17c-9981-4b05-baa1-b88f5735fd8c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:13.304507 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b02cc17c-9981-4b05-baa1-b88f5735fd8c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:13.305870 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b02cc17c-9981-4b05-baa1-b88f5735fd8c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:13.306600 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b02cc17c-9981-4b05-baa1-b88f5735fd8c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:13.307311 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b02cc17c-9981-4b05-baa1-b88f5735fd8c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:13.721070 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-b02cc17c-9981-4b05-baa1-b88f5735fd8c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:13.752839 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-b02cc17c-9981-4b05-baa1-b88f5735fd8c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:13.757812 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-b02cc17c-9981-4b05-baa1-b88f5735fd8c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:13.760307 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b02cc17c-9981-4b05-baa1-b88f5735fd8c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1740 microversion: 2.20 time: 0.472668 Sep 06 01:14:13.764097 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 197/404] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:14:13 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1740 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:14:13.773046 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2aed5323-b021-4da6-9591-5ce4cadc8bb7 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:13.775780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2aed5323-b021-4da6-9591-5ce4cadc8bb7 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] [instance: dff4f970-9216-4d56-81d9-f62b12ebccff] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:13.840649 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-27ee9271-66ed-4a87-9736-3ce257683f42 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Flavor limits 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 01:14:13.841226 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-27ee9271-66ed-4a87-9736-3ce257683f42 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Image limits 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 01:14:13.841777 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-27ee9271-66ed-4a87-9736-3ce257683f42 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Flavor pref 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 01:14:13.842311 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-27ee9271-66ed-4a87-9736-3ce257683f42 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Image pref 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 01:14:13.842799 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-27ee9271-66ed-4a87-9736-3ce257683f42 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 01:14:13.854363 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-27ee9271-66ed-4a87-9736-3ce257683f42 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:13.855325 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-27ee9271-66ed-4a87-9736-3ce257683f42 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:13.858144 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-27ee9271-66ed-4a87-9736-3ce257683f42 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:13.859156 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-27ee9271-66ed-4a87-9736-3ce257683f42 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:13.860408 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-27ee9271-66ed-4a87-9736-3ce257683f42 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:13.861564 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-27ee9271-66ed-4a87-9736-3ce257683f42 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:13.870245 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-2aed5323-b021-4da6-9591-5ce4cadc8bb7 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c48bdc1644230a97a6d9b8fe8f9f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd22b3b78f416ab10fd92ac92a5589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:13.878435 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2aed5323-b021-4da6-9591-5ce4cadc8bb7 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] 10.222.0.23 "GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff" status: 200 len: 1214 microversion: 2.1 time: 0.112046 Sep 06 01:14:13.879473 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 198/405] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:13 2022] GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff => generated 1214 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:13.885803 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-98d58518-06b4-4ed0-837e-59e8cbf9ca89 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:13.886405 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-98d58518-06b4-4ed0-837e-59e8cbf9ca89 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:13.892524 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98d58518-06b4-4ed0-837e-59e8cbf9ca89 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:13.893291 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98d58518-06b4-4ed0-837e-59e8cbf9ca89 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:13.893946 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98d58518-06b4-4ed0-837e-59e8cbf9ca89 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:13.894964 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98d58518-06b4-4ed0-837e-59e8cbf9ca89 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:13.896324 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98d58518-06b4-4ed0-837e-59e8cbf9ca89 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:13.896897 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98d58518-06b4-4ed0-837e-59e8cbf9ca89 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:13.904538 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.quota [None req-27ee9271-66ed-4a87-9736-3ce257683f42 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Getting quotas for project 91ee5ad0b4064b9d8a038980786072cb. Resources: {'instances', 'ram', 'cores'} {{(pid=120580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 01:14:13.909316 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.quota [None req-27ee9271-66ed-4a87-9736-3ce257683f42 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Getting quotas for user 703464e4a9524efaa8fdfc1870158cbb and project 91ee5ad0b4064b9d8a038980786072cb. Resources: {'instances', 'ram', 'cores'} {{(pid=120580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 01:14:13.926202 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-27ee9271-66ed-4a87-9736-3ce257683f42 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Going to run 1 instances... {{(pid=120580) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 01:14:13.929425 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-27ee9271-66ed-4a87-9736-3ce257683f42 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='768973cc-7b5f-4eed-b493-e40eb0de9f88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 01:14:14.087085 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-27ee9271-66ed-4a87-9736-3ce257683f42 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.673599 Sep 06 01:14:14.089303 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 208/406] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Sep 6 01:14:12 2022] POST /compute/v2.1/servers => generated 409 bytes in 1692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 01:14:14.101646 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-f62c53e1-a496-4728-8cd4-432c98545939 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:14.102349 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-f62c53e1-a496-4728-8cd4-432c98545939 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:14.121619 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-98d58518-06b4-4ed0-837e-59e8cbf9ca89 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:14.147230 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-98d58518-06b4-4ed0-837e-59e8cbf9ca89 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5" status: 200 len: 1368 microversion: 2.1 time: 0.266497 Sep 06 01:14:14.169206 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 199/407] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:13 2022] GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5 => generated 1368 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:14.265440 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-f62c53e1-a496-4728-8cd4-432c98545939 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:14.273829 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-f62c53e1-a496-4728-8cd4-432c98545939 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1246 microversion: 2.1 time: 0.177258 Sep 06 01:14:14.274765 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 209/408] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:14 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1246 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:14.798480 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d1c5e24e-dbcc-4792-b01d-324d3a37b606 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:14.799105 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d1c5e24e-dbcc-4792-b01d-324d3a37b606 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:14.806790 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d1c5e24e-dbcc-4792-b01d-324d3a37b606 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:14.807654 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d1c5e24e-dbcc-4792-b01d-324d3a37b606 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:14.808306 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d1c5e24e-dbcc-4792-b01d-324d3a37b606 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:14.809199 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d1c5e24e-dbcc-4792-b01d-324d3a37b606 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:14.809810 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d1c5e24e-dbcc-4792-b01d-324d3a37b606 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:14.810509 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d1c5e24e-dbcc-4792-b01d-324d3a37b606 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:14.907092 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-4e9fcdc6-eed3-43a1-a953-136333ffa1e6 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:14.908106 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-4e9fcdc6-eed3-43a1-a953-136333ffa1e6 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] [instance: dff4f970-9216-4d56-81d9-f62b12ebccff] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:14.922083 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4e9fcdc6-eed3-43a1-a953-136333ffa1e6 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:14.922665 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4e9fcdc6-eed3-43a1-a953-136333ffa1e6 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:14.923230 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4e9fcdc6-eed3-43a1-a953-136333ffa1e6 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:14.924089 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4e9fcdc6-eed3-43a1-a953-136333ffa1e6 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:14.924612 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4e9fcdc6-eed3-43a1-a953-136333ffa1e6 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:14.925104 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4e9fcdc6-eed3-43a1-a953-136333ffa1e6 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:15.278916 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-4e9fcdc6-eed3-43a1-a953-136333ffa1e6 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c48bdc1644230a97a6d9b8fe8f9f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd22b3b78f416ab10fd92ac92a5589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:15.288152 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-4e9fcdc6-eed3-43a1-a953-136333ffa1e6 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] 10.222.0.23 "GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff" status: 200 len: 1266 microversion: 2.1 time: 0.385150 Sep 06 01:14:15.289288 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 210/409] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:14 2022] GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff => generated 1266 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:14:15.295502 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-f2e60836-2db4-4ccc-8e33-870d9399168b tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:15.296666 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-f2e60836-2db4-4ccc-8e33-870d9399168b tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 7589d872-fdde-4504-b16e-1f16598c41d3] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:15.308214 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f2e60836-2db4-4ccc-8e33-870d9399168b tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:15.309024 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f2e60836-2db4-4ccc-8e33-870d9399168b tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:15.309720 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f2e60836-2db4-4ccc-8e33-870d9399168b tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:15.311236 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f2e60836-2db4-4ccc-8e33-870d9399168b tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:15.312006 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f2e60836-2db4-4ccc-8e33-870d9399168b tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:15.312654 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f2e60836-2db4-4ccc-8e33-870d9399168b tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:15.331935 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-d1c5e24e-dbcc-4792-b01d-324d3a37b606 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:15.346722 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-f2e60836-2db4-4ccc-8e33-870d9399168b tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 7589d872-fdde-4504-b16e-1f16598c41d3] Going to try to terminate instance {{(pid=120580) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 01:14:15.351389 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-d1c5e24e-dbcc-4792-b01d-324d3a37b606 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:15.353343 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-d1c5e24e-dbcc-4792-b01d-324d3a37b606 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:15.354560 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d1c5e24e-dbcc-4792-b01d-324d3a37b606 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1722 microversion: 2.20 time: 0.560405 Sep 06 01:14:15.375684 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 200/410] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:14:14 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1722 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:14:15.381395 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-57177180-8758-47e6-8793-43c59d882c50 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:15.382241 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-57177180-8758-47e6-8793-43c59d882c50 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:15.388459 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57177180-8758-47e6-8793-43c59d882c50 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:15.389185 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57177180-8758-47e6-8793-43c59d882c50 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:15.389794 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57177180-8758-47e6-8793-43c59d882c50 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:15.390773 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57177180-8758-47e6-8793-43c59d882c50 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:15.391391 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57177180-8758-47e6-8793-43c59d882c50 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:15.392007 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57177180-8758-47e6-8793-43c59d882c50 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:15.488913 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-f2e60836-2db4-4ccc-8e33-870d9399168b tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7589d872-fdde-4504-b16e-1f16598c41d3" status: 204 len: 0 microversion: 2.1 time: 0.195812 Sep 06 01:14:15.494234 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 211/411] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 6 01:14:15 2022] DELETE /compute/v2.1/servers/7589d872-fdde-4504-b16e-1f16598c41d3 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 01:14:15.515939 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-3675203d-0e4d-49fc-9029-e15342045d02 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:15.516876 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-3675203d-0e4d-49fc-9029-e15342045d02 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:15.527956 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3675203d-0e4d-49fc-9029-e15342045d02 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:15.528376 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3675203d-0e4d-49fc-9029-e15342045d02 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:15.528819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3675203d-0e4d-49fc-9029-e15342045d02 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:15.529531 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3675203d-0e4d-49fc-9029-e15342045d02 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:15.529989 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3675203d-0e4d-49fc-9029-e15342045d02 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:15.530418 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3675203d-0e4d-49fc-9029-e15342045d02 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:15.614610 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-3675203d-0e4d-49fc-9029-e15342045d02 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:15.628456 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-3675203d-0e4d-49fc-9029-e15342045d02 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1298 microversion: 2.1 time: 0.132057 Sep 06 01:14:15.630711 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 212/412] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:15 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1298 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:15.642312 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-57177180-8758-47e6-8793-43c59d882c50 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:15.651493 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-57177180-8758-47e6-8793-43c59d882c50 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5" status: 200 len: 1368 microversion: 2.1 time: 0.274391 Sep 06 01:14:15.653326 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 201/413] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:15 2022] GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5 => generated 1368 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:15.655281 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-edeba64d-6928-4b87-9ede-25b4a7b15240 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:15.656267 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-edeba64d-6928-4b87-9ede-25b4a7b15240 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 7589d872-fdde-4504-b16e-1f16598c41d3] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:15.664585 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-edeba64d-6928-4b87-9ede-25b4a7b15240 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:15.665392 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-edeba64d-6928-4b87-9ede-25b4a7b15240 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:15.666057 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-edeba64d-6928-4b87-9ede-25b4a7b15240 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:15.667014 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-edeba64d-6928-4b87-9ede-25b4a7b15240 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:15.667706 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-edeba64d-6928-4b87-9ede-25b4a7b15240 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:15.668635 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-edeba64d-6928-4b87-9ede-25b4a7b15240 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:15.819562 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-edeba64d-6928-4b87-9ede-25b4a7b15240 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:15.831275 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-edeba64d-6928-4b87-9ede-25b4a7b15240 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/7589d872-fdde-4504-b16e-1f16598c41d3" status: 200 len: 1513 microversion: 2.1 time: 0.198180 Sep 06 01:14:15.832637 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 213/414] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:15 2022] GET /compute/v2.1/servers/7589d872-fdde-4504-b16e-1f16598c41d3 => generated 1513 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:16.312066 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-25af5c8d-ef8a-49a4-9248-d591cef1386a tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:16.313154 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-25af5c8d-ef8a-49a4-9248-d591cef1386a tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] [instance: dff4f970-9216-4d56-81d9-f62b12ebccff] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:16.331321 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25af5c8d-ef8a-49a4-9248-d591cef1386a tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:16.331983 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25af5c8d-ef8a-49a4-9248-d591cef1386a tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:16.332875 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25af5c8d-ef8a-49a4-9248-d591cef1386a tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:16.334786 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25af5c8d-ef8a-49a4-9248-d591cef1386a tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:16.335549 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25af5c8d-ef8a-49a4-9248-d591cef1386a tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:16.336127 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25af5c8d-ef8a-49a4-9248-d591cef1386a tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:16.383956 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-fe79b51d-6807-4f35-bece-26b88707b019 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:16.384708 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-fe79b51d-6807-4f35-bece-26b88707b019 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:16.400869 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fe79b51d-6807-4f35-bece-26b88707b019 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:16.402197 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fe79b51d-6807-4f35-bece-26b88707b019 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:16.402937 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fe79b51d-6807-4f35-bece-26b88707b019 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:16.404030 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fe79b51d-6807-4f35-bece-26b88707b019 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:16.404674 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fe79b51d-6807-4f35-bece-26b88707b019 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:16.406116 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fe79b51d-6807-4f35-bece-26b88707b019 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:16.418929 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-25af5c8d-ef8a-49a4-9248-d591cef1386a tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c48bdc1644230a97a6d9b8fe8f9f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd22b3b78f416ab10fd92ac92a5589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:16.428786 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-25af5c8d-ef8a-49a4-9248-d591cef1386a tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] 10.222.0.23 "GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff" status: 200 len: 1274 microversion: 2.1 time: 0.121029 Sep 06 01:14:16.444394 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 202/415] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:16 2022] GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff => generated 1274 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:16.606892 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-fe79b51d-6807-4f35-bece-26b88707b019 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:16.618381 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-fe79b51d-6807-4f35-bece-26b88707b019 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:16.620142 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-fe79b51d-6807-4f35-bece-26b88707b019 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:16.622282 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-fe79b51d-6807-4f35-bece-26b88707b019 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1722 microversion: 2.20 time: 0.243505 Sep 06 01:14:16.623191 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 214/416] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:14:16 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:14:16.660802 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-964bd2a5-09ba-4622-a9fe-6e847f5948f6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:16.661902 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-964bd2a5-09ba-4622-a9fe-6e847f5948f6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:16.668817 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-964bd2a5-09ba-4622-a9fe-6e847f5948f6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:16.669527 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-964bd2a5-09ba-4622-a9fe-6e847f5948f6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:16.670166 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-964bd2a5-09ba-4622-a9fe-6e847f5948f6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:16.671048 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-964bd2a5-09ba-4622-a9fe-6e847f5948f6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:16.671650 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-964bd2a5-09ba-4622-a9fe-6e847f5948f6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:16.672256 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-964bd2a5-09ba-4622-a9fe-6e847f5948f6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:16.678246 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-5260236b-9396-4b5d-860a-e08dd327473d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:16.679145 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-5260236b-9396-4b5d-860a-e08dd327473d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:16.688215 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5260236b-9396-4b5d-860a-e08dd327473d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:16.690984 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5260236b-9396-4b5d-860a-e08dd327473d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:16.693140 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5260236b-9396-4b5d-860a-e08dd327473d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:16.696633 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5260236b-9396-4b5d-860a-e08dd327473d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:16.697111 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5260236b-9396-4b5d-860a-e08dd327473d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:16.708632 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5260236b-9396-4b5d-860a-e08dd327473d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:16.826425 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-964bd2a5-09ba-4622-a9fe-6e847f5948f6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:16.837333 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-964bd2a5-09ba-4622-a9fe-6e847f5948f6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1298 microversion: 2.1 time: 0.178186 Sep 06 01:14:16.837929 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 203/417] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:16 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1298 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:16.861704 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b3f70c48-96a2-44d4-9b9c-562a5cb7b5dc tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:16.862353 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b3f70c48-96a2-44d4-9b9c-562a5cb7b5dc tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 7589d872-fdde-4504-b16e-1f16598c41d3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:16.877599 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b3f70c48-96a2-44d4-9b9c-562a5cb7b5dc tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:16.878248 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b3f70c48-96a2-44d4-9b9c-562a5cb7b5dc tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:16.878691 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b3f70c48-96a2-44d4-9b9c-562a5cb7b5dc tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:16.879394 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b3f70c48-96a2-44d4-9b9c-562a5cb7b5dc tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:16.879926 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b3f70c48-96a2-44d4-9b9c-562a5cb7b5dc tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:16.880340 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b3f70c48-96a2-44d4-9b9c-562a5cb7b5dc tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:16.961197 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-5260236b-9396-4b5d-860a-e08dd327473d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:16.969834 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-5260236b-9396-4b5d-860a-e08dd327473d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5" status: 200 len: 1368 microversion: 2.1 time: 0.295506 Sep 06 01:14:16.972453 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 215/418] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:16 2022] GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5 => generated 1368 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:14:17.231501 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-b3f70c48-96a2-44d4-9b9c-562a5cb7b5dc tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:17.238096 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:17.245565 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b3f70c48-96a2-44d4-9b9c-562a5cb7b5dc tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/7589d872-fdde-4504-b16e-1f16598c41d3" status: 200 len: 1513 microversion: 2.1 time: 0.394030 Sep 06 01:14:17.249264 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 204/419] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:16 2022] GET /compute/v2.1/servers/7589d872-fdde-4504-b16e-1f16598c41d3 => generated 1513 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:14:17.453490 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-97d45fc4-9184-4d3d-b368-353e827b0a8b tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:17.454724 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-97d45fc4-9184-4d3d-b368-353e827b0a8b tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] [instance: dff4f970-9216-4d56-81d9-f62b12ebccff] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:17.462193 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-97d45fc4-9184-4d3d-b368-353e827b0a8b tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:17.462870 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-97d45fc4-9184-4d3d-b368-353e827b0a8b tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:17.463474 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-97d45fc4-9184-4d3d-b368-353e827b0a8b tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:17.464381 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-97d45fc4-9184-4d3d-b368-353e827b0a8b tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:17.464839 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-97d45fc4-9184-4d3d-b368-353e827b0a8b tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:17.465268 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-97d45fc4-9184-4d3d-b368-353e827b0a8b tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:17.547024 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-97d45fc4-9184-4d3d-b368-353e827b0a8b tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c48bdc1644230a97a6d9b8fe8f9f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd22b3b78f416ab10fd92ac92a5589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:17.556827 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-97d45fc4-9184-4d3d-b368-353e827b0a8b tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] 10.222.0.23 "GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff" status: 200 len: 1272 microversion: 2.1 time: 0.107143 Sep 06 01:14:17.568298 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 216/420] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:17 2022] GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff => generated 1272 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:17.659099 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-28bfa914-d082-4f12-8b23-cc2fa0fbfc93 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:17.660950 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-28bfa914-d082-4f12-8b23-cc2fa0fbfc93 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:17.669404 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28bfa914-d082-4f12-8b23-cc2fa0fbfc93 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:17.670123 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28bfa914-d082-4f12-8b23-cc2fa0fbfc93 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:17.671026 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28bfa914-d082-4f12-8b23-cc2fa0fbfc93 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:17.671965 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28bfa914-d082-4f12-8b23-cc2fa0fbfc93 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:17.672424 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28bfa914-d082-4f12-8b23-cc2fa0fbfc93 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:17.673047 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28bfa914-d082-4f12-8b23-cc2fa0fbfc93 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:17.865230 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-62320e79-3469-4d81-a304-2ce40421a0c6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:17.866070 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-62320e79-3469-4d81-a304-2ce40421a0c6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:17.873208 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-62320e79-3469-4d81-a304-2ce40421a0c6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:17.873910 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-62320e79-3469-4d81-a304-2ce40421a0c6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:17.874783 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-62320e79-3469-4d81-a304-2ce40421a0c6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:17.875831 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-62320e79-3469-4d81-a304-2ce40421a0c6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:17.876440 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-62320e79-3469-4d81-a304-2ce40421a0c6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:17.877020 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-62320e79-3469-4d81-a304-2ce40421a0c6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:17.909713 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-28bfa914-d082-4f12-8b23-cc2fa0fbfc93 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:17.937640 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-28bfa914-d082-4f12-8b23-cc2fa0fbfc93 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:17.943134 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-28bfa914-d082-4f12-8b23-cc2fa0fbfc93 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:17.947731 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-28bfa914-d082-4f12-8b23-cc2fa0fbfc93 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1722 microversion: 2.20 time: 0.294759 Sep 06 01:14:17.949597 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 205/421] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:14:17 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1722 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:14:17.999219 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a6935604-8e9e-443d-a0b0-8c56fdaf0a33 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:18.000090 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a6935604-8e9e-443d-a0b0-8c56fdaf0a33 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:18.009348 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6935604-8e9e-443d-a0b0-8c56fdaf0a33 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:18.010224 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6935604-8e9e-443d-a0b0-8c56fdaf0a33 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:18.010922 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6935604-8e9e-443d-a0b0-8c56fdaf0a33 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:18.012109 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6935604-8e9e-443d-a0b0-8c56fdaf0a33 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:18.012901 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6935604-8e9e-443d-a0b0-8c56fdaf0a33 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:18.013567 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6935604-8e9e-443d-a0b0-8c56fdaf0a33 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:18.017639 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-62320e79-3469-4d81-a304-2ce40421a0c6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:18.026079 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-62320e79-3469-4d81-a304-2ce40421a0c6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1298 microversion: 2.1 time: 0.165655 Sep 06 01:14:18.026653 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 217/422] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:17 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1298 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:14:18.243888 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-a6935604-8e9e-443d-a0b0-8c56fdaf0a33 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:18.252648 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a6935604-8e9e-443d-a0b0-8c56fdaf0a33 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5" status: 200 len: 1368 microversion: 2.1 time: 0.259743 Sep 06 01:14:18.275523 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-b6a3b7ba-90b2-40e7-bb13-09caa7f57e59 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:18.276720 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-b6a3b7ba-90b2-40e7-bb13-09caa7f57e59 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 7589d872-fdde-4504-b16e-1f16598c41d3] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:18.279110 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 206/423] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:17 2022] GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5 => generated 1368 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:14:18.307899 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b6a3b7ba-90b2-40e7-bb13-09caa7f57e59 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:18.308890 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b6a3b7ba-90b2-40e7-bb13-09caa7f57e59 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:18.309439 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b6a3b7ba-90b2-40e7-bb13-09caa7f57e59 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:18.310305 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b6a3b7ba-90b2-40e7-bb13-09caa7f57e59 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:18.310872 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b6a3b7ba-90b2-40e7-bb13-09caa7f57e59 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:18.311426 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b6a3b7ba-90b2-40e7-bb13-09caa7f57e59 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:18.316811 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:18.480236 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-b6a3b7ba-90b2-40e7-bb13-09caa7f57e59 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:18.491322 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-b6a3b7ba-90b2-40e7-bb13-09caa7f57e59 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/7589d872-fdde-4504-b16e-1f16598c41d3" status: 200 len: 1513 microversion: 2.1 time: 0.220280 Sep 06 01:14:18.492470 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 218/424] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:18 2022] GET /compute/v2.1/servers/7589d872-fdde-4504-b16e-1f16598c41d3 => generated 1513 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:18.583064 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-21290861-0c6a-44ae-84df-a913c9497213 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:18.583688 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-21290861-0c6a-44ae-84df-a913c9497213 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] [instance: dff4f970-9216-4d56-81d9-f62b12ebccff] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:18.591169 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-21290861-0c6a-44ae-84df-a913c9497213 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:18.591663 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-21290861-0c6a-44ae-84df-a913c9497213 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:18.592137 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-21290861-0c6a-44ae-84df-a913c9497213 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:18.592847 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-21290861-0c6a-44ae-84df-a913c9497213 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:18.593304 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-21290861-0c6a-44ae-84df-a913c9497213 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:18.593731 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-21290861-0c6a-44ae-84df-a913c9497213 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:18.682952 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-21290861-0c6a-44ae-84df-a913c9497213 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c48bdc1644230a97a6d9b8fe8f9f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd22b3b78f416ab10fd92ac92a5589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:18.692104 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-21290861-0c6a-44ae-84df-a913c9497213 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] 10.222.0.23 "GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff" status: 200 len: 1272 microversion: 2.1 time: 0.114962 Sep 06 01:14:18.693421 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 207/425] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:18 2022] GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff => generated 1272 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:18.786832 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-6e10a94f-e9ce-455d-b3fc-eadec4abfecd req-1ddb78f3-9983-43a3-92eb-5f686ebe76fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9a2a405-dce3-4320-b44d-a19c556501b5", "name": "network-vif-plugged", "status": "completed", "tag": "1d34bce1-fa87-41f6-98ae-7a1f148c1081"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:14:18.810906 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-6e10a94f-e9ce-455d-b3fc-eadec4abfecd req-1ddb78f3-9983-43a3-92eb-5f686ebe76fb service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:18.812308 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-6e10a94f-e9ce-455d-b3fc-eadec4abfecd req-1ddb78f3-9983-43a3-92eb-5f686ebe76fb service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:18.813041 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-6e10a94f-e9ce-455d-b3fc-eadec4abfecd req-1ddb78f3-9983-43a3-92eb-5f686ebe76fb service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:18.827985 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.compute.server_external_events [req-6e10a94f-e9ce-455d-b3fc-eadec4abfecd req-1ddb78f3-9983-43a3-92eb-5f686ebe76fb service nova] Creating event network-vif-plugged:1d34bce1-fa87-41f6-98ae-7a1f148c1081 for instance f9a2a405-dce3-4320-b44d-a19c556501b5 on hv-cinder-84773 Sep 06 01:14:18.835311 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [req-6e10a94f-e9ce-455d-b3fc-eadec4abfecd req-1ddb78f3-9983-43a3-92eb-5f686ebe76fb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054281 Sep 06 01:14:18.836732 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 219/426] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:14:18.976625 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3b48ecac-d978-4a16-b8c4-20991c1a6223 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:18.981280 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3b48ecac-d978-4a16-b8c4-20991c1a6223 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:18.996121 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3b48ecac-d978-4a16-b8c4-20991c1a6223 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:18.996832 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3b48ecac-d978-4a16-b8c4-20991c1a6223 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:18.997470 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3b48ecac-d978-4a16-b8c4-20991c1a6223 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:18.998437 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3b48ecac-d978-4a16-b8c4-20991c1a6223 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:18.999947 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3b48ecac-d978-4a16-b8c4-20991c1a6223 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:19.000627 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3b48ecac-d978-4a16-b8c4-20991c1a6223 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:19.052304 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-51dd3472-20b9-49e9-b131-6ef2017b7426 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:19.053386 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-51dd3472-20b9-49e9-b131-6ef2017b7426 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:19.064411 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-51dd3472-20b9-49e9-b131-6ef2017b7426 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:19.071596 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-51dd3472-20b9-49e9-b131-6ef2017b7426 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:19.072671 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-51dd3472-20b9-49e9-b131-6ef2017b7426 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:19.073724 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-51dd3472-20b9-49e9-b131-6ef2017b7426 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:19.074519 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-51dd3472-20b9-49e9-b131-6ef2017b7426 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:19.075527 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-51dd3472-20b9-49e9-b131-6ef2017b7426 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:19.233048 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-51dd3472-20b9-49e9-b131-6ef2017b7426 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:19.250097 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-51dd3472-20b9-49e9-b131-6ef2017b7426 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1298 microversion: 2.1 time: 0.197559 Sep 06 01:14:19.250589 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 220/427] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:19 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1298 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:14:19.282225 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-8485b626-4b9d-4de4-8329-4a69f52be888 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:19.282922 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-8485b626-4b9d-4de4-8329-4a69f52be888 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:19.298136 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8485b626-4b9d-4de4-8329-4a69f52be888 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:19.298454 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8485b626-4b9d-4de4-8329-4a69f52be888 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:19.298894 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8485b626-4b9d-4de4-8329-4a69f52be888 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:19.299643 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8485b626-4b9d-4de4-8329-4a69f52be888 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:19.300133 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8485b626-4b9d-4de4-8329-4a69f52be888 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:19.300560 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8485b626-4b9d-4de4-8329-4a69f52be888 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:20.011212 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-3b48ecac-d978-4a16-b8c4-20991c1a6223 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:20.024641 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-3b48ecac-d978-4a16-b8c4-20991c1a6223 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:20.026550 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-3b48ecac-d978-4a16-b8c4-20991c1a6223 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:20.035809 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3b48ecac-d978-4a16-b8c4-20991c1a6223 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1722 microversion: 2.20 time: 1.065070 Sep 06 01:14:20.036842 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 208/428] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:14:18 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1722 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:14:20.041840 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c5c41640-0952-41d7-a43f-b1ccda3915a0 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:20.042444 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c5c41640-0952-41d7-a43f-b1ccda3915a0 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 7589d872-fdde-4504-b16e-1f16598c41d3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:20.060707 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5c41640-0952-41d7-a43f-b1ccda3915a0 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:20.061462 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5c41640-0952-41d7-a43f-b1ccda3915a0 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:20.062085 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5c41640-0952-41d7-a43f-b1ccda3915a0 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:20.062785 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5c41640-0952-41d7-a43f-b1ccda3915a0 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:20.063237 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5c41640-0952-41d7-a43f-b1ccda3915a0 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:20.063650 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5c41640-0952-41d7-a43f-b1ccda3915a0 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:20.090393 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-8485b626-4b9d-4de4-8329-4a69f52be888 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:20.125545 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-8485b626-4b9d-4de4-8329-4a69f52be888 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5" status: 200 len: 1368 microversion: 2.1 time: 0.845903 Sep 06 01:14:20.127108 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 221/429] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:19 2022] GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5 => generated 1368 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:14:20.156681 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-0c63da5f-81fa-4fd1-86a5-ccbc96533a1c tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:20.157288 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-0c63da5f-81fa-4fd1-86a5-ccbc96533a1c tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] [instance: dff4f970-9216-4d56-81d9-f62b12ebccff] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:20.166625 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0c63da5f-81fa-4fd1-86a5-ccbc96533a1c tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:20.167114 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0c63da5f-81fa-4fd1-86a5-ccbc96533a1c tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:20.167551 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0c63da5f-81fa-4fd1-86a5-ccbc96533a1c tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:20.168526 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0c63da5f-81fa-4fd1-86a5-ccbc96533a1c tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:20.168976 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0c63da5f-81fa-4fd1-86a5-ccbc96533a1c tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:20.169396 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0c63da5f-81fa-4fd1-86a5-ccbc96533a1c tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:20.439009 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-0c63da5f-81fa-4fd1-86a5-ccbc96533a1c tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c48bdc1644230a97a6d9b8fe8f9f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd22b3b78f416ab10fd92ac92a5589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:20.450619 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-0c63da5f-81fa-4fd1-86a5-ccbc96533a1c tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] 10.222.0.23 "GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff" status: 200 len: 1272 microversion: 2.1 time: 0.297569 Sep 06 01:14:20.460686 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 222/430] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:20 2022] GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff => generated 1272 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:20.475990 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-004675be-ed9b-4c76-95c0-f3103372f980 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:20.476937 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-004675be-ed9b-4c76-95c0-f3103372f980 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:20.491500 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-004675be-ed9b-4c76-95c0-f3103372f980 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:20.492291 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-004675be-ed9b-4c76-95c0-f3103372f980 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:20.492924 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-004675be-ed9b-4c76-95c0-f3103372f980 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:20.494476 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-004675be-ed9b-4c76-95c0-f3103372f980 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:20.495095 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-004675be-ed9b-4c76-95c0-f3103372f980 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:20.495674 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-004675be-ed9b-4c76-95c0-f3103372f980 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:20.633404 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-c5c41640-0952-41d7-a43f-b1ccda3915a0 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:20.643373 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c5c41640-0952-41d7-a43f-b1ccda3915a0 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/7589d872-fdde-4504-b16e-1f16598c41d3" status: 200 len: 1513 microversion: 2.1 time: 0.605290 Sep 06 01:14:20.646819 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 209/431] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:20 2022] GET /compute/v2.1/servers/7589d872-fdde-4504-b16e-1f16598c41d3 => generated 1513 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:20.742008 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-004675be-ed9b-4c76-95c0-f3103372f980 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:20.753637 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-004675be-ed9b-4c76-95c0-f3103372f980 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1304 microversion: 2.1 time: 0.291656 Sep 06 01:14:20.754766 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 223/432] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:20 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1304 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:20.865946 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-e467df1f-7fdb-4e56-b692-0eb0d24e029d req-852ea62c-60f8-45c2-b305-a4bef632a727 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c42df4ca-a678-4b12-b5dc-3f3c0af93125", "name": "network-vif-unplugged", "status": "completed", "tag": "9f5084ac-bd14-44b7-bba5-06b59fd5291e"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:14:20.903235 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e467df1f-7fdb-4e56-b692-0eb0d24e029d req-852ea62c-60f8-45c2-b305-a4bef632a727 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:20.903936 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e467df1f-7fdb-4e56-b692-0eb0d24e029d req-852ea62c-60f8-45c2-b305-a4bef632a727 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:20.912636 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e467df1f-7fdb-4e56-b692-0eb0d24e029d req-852ea62c-60f8-45c2-b305-a4bef632a727 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:20.932153 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-e467df1f-7fdb-4e56-b692-0eb0d24e029d req-852ea62c-60f8-45c2-b305-a4bef632a727 service nova] Creating event network-vif-unplugged:9f5084ac-bd14-44b7-bba5-06b59fd5291e for instance c42df4ca-a678-4b12-b5dc-3f3c0af93125 on hv-cinder-84773 Sep 06 01:14:20.944164 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-e467df1f-7fdb-4e56-b692-0eb0d24e029d req-852ea62c-60f8-45c2-b305-a4bef632a727 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083534 Sep 06 01:14:20.947690 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 210/433] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:14:21.070387 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-0266aeba-5bda-42e7-b462-220bad7eab4a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:21.072765 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-0266aeba-5bda-42e7-b462-220bad7eab4a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:21.082848 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0266aeba-5bda-42e7-b462-220bad7eab4a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:21.083405 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0266aeba-5bda-42e7-b462-220bad7eab4a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:21.083884 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0266aeba-5bda-42e7-b462-220bad7eab4a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:21.084595 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0266aeba-5bda-42e7-b462-220bad7eab4a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:21.085064 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0266aeba-5bda-42e7-b462-220bad7eab4a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:21.087021 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0266aeba-5bda-42e7-b462-220bad7eab4a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:21.156847 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-38f27c9f-0695-44cb-a8c3-de8523e05c27 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:21.159781 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-38f27c9f-0695-44cb-a8c3-de8523e05c27 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:21.180613 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38f27c9f-0695-44cb-a8c3-de8523e05c27 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:21.181719 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38f27c9f-0695-44cb-a8c3-de8523e05c27 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:21.182481 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38f27c9f-0695-44cb-a8c3-de8523e05c27 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:21.184783 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38f27c9f-0695-44cb-a8c3-de8523e05c27 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:21.185458 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38f27c9f-0695-44cb-a8c3-de8523e05c27 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:21.186608 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38f27c9f-0695-44cb-a8c3-de8523e05c27 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:21.531058 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-38f27c9f-0695-44cb-a8c3-de8523e05c27 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:21.537267 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-0266aeba-5bda-42e7-b462-220bad7eab4a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:21.546855 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-0266aeba-5bda-42e7-b462-220bad7eab4a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:21.547207 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-38f27c9f-0695-44cb-a8c3-de8523e05c27 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5" status: 200 len: 1368 microversion: 2.1 time: 0.397244 Sep 06 01:14:21.548347 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-0266aeba-5bda-42e7-b462-220bad7eab4a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:21.549530 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-0266aeba-5bda-42e7-b462-220bad7eab4a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1725 microversion: 2.20 time: 0.483569 Sep 06 01:14:21.565941 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 211/434] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:21 2022] GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5 => generated 1368 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:21.574824 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-8819300a-2a3c-41eb-8815-38a603ee00f2 req-a9ff041f-ee01-4045-931b-fbc620e0f2df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7589d872-fdde-4504-b16e-1f16598c41d3", "name": "network-vif-deleted", "tag": "946c2665-f95b-40c9-a6fe-05585859c278"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:14:21.580859 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 224/435] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:14:21 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1725 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:14:21.588564 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8819300a-2a3c-41eb-8815-38a603ee00f2 req-a9ff041f-ee01-4045-931b-fbc620e0f2df service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:21.588564 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8819300a-2a3c-41eb-8815-38a603ee00f2 req-a9ff041f-ee01-4045-931b-fbc620e0f2df service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:21.588835 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8819300a-2a3c-41eb-8815-38a603ee00f2 req-a9ff041f-ee01-4045-931b-fbc620e0f2df service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:21.605662 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-10d47503-c08b-4d1b-8a76-9908f24bceea tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:21.606294 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-10d47503-c08b-4d1b-8a76-9908f24bceea tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] [instance: dff4f970-9216-4d56-81d9-f62b12ebccff] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:21.607508 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-8819300a-2a3c-41eb-8815-38a603ee00f2 req-a9ff041f-ee01-4045-931b-fbc620e0f2df service nova] Creating event network-vif-deleted:946c2665-f95b-40c9-a6fe-05585859c278 for instance 7589d872-fdde-4504-b16e-1f16598c41d3 on hv-cinder-84773 Sep 06 01:14:21.624691 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-8819300a-2a3c-41eb-8815-38a603ee00f2 req-a9ff041f-ee01-4045-931b-fbc620e0f2df service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056972 Sep 06 01:14:21.625043 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-10d47503-c08b-4d1b-8a76-9908f24bceea tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:21.625727 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-10d47503-c08b-4d1b-8a76-9908f24bceea tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:21.625852 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 212/436] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:14:21.626474 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-10d47503-c08b-4d1b-8a76-9908f24bceea tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:21.627365 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-10d47503-c08b-4d1b-8a76-9908f24bceea tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:21.628142 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-10d47503-c08b-4d1b-8a76-9908f24bceea tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:21.629286 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-10d47503-c08b-4d1b-8a76-9908f24bceea tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:21.639607 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1b4b2146-7690-461b-841b-2630615d106d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "195e466f-2a60-465a-8e2c-838dfdb5c139"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:14:21.642694 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1b4b2146-7690-461b-841b-2630615d106d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:21.651267 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b4b2146-7690-461b-841b-2630615d106d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:21.652113 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b4b2146-7690-461b-841b-2630615d106d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:21.652777 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b4b2146-7690-461b-841b-2630615d106d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:21.653752 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b4b2146-7690-461b-841b-2630615d106d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:21.654399 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b4b2146-7690-461b-841b-2630615d106d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:21.655097 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b4b2146-7690-461b-841b-2630615d106d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:22.293850 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1b4b2146-7690-461b-841b-2630615d106d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "POST /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.660423 Sep 06 01:14:22.295930 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 213/437] 10.222.0.23 () {62 vars in 1364 bytes} [Tue Sep 6 01:14:21 2022] POST /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125/os-volume_attachments => generated 188 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 01:14:22.332011 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-92ce626d-4e36-4719-bac3-46e331af79ff tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:22.333624 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-92ce626d-4e36-4719-bac3-46e331af79ff tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 7589d872-fdde-4504-b16e-1f16598c41d3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:22.341382 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92ce626d-4e36-4719-bac3-46e331af79ff tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:22.349384 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92ce626d-4e36-4719-bac3-46e331af79ff tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:22.349836 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92ce626d-4e36-4719-bac3-46e331af79ff tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:22.350574 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92ce626d-4e36-4719-bac3-46e331af79ff tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:22.351026 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92ce626d-4e36-4719-bac3-46e331af79ff tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:22.351451 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92ce626d-4e36-4719-bac3-46e331af79ff tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:22.412888 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92ce626d-4e36-4719-bac3-46e331af79ff tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:22.415607 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92ce626d-4e36-4719-bac3-46e331af79ff tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:22.417204 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92ce626d-4e36-4719-bac3-46e331af79ff tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:22.418248 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-92ce626d-4e36-4719-bac3-46e331af79ff tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lazy-loading 'fault' on Instance uuid 7589d872-fdde-4504-b16e-1f16598c41d3 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 01:14:22.471225 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-10d47503-c08b-4d1b-8a76-9908f24bceea tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c48bdc1644230a97a6d9b8fe8f9f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd22b3b78f416ab10fd92ac92a5589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:22.493612 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-10d47503-c08b-4d1b-8a76-9908f24bceea tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] 10.222.0.23 "GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff" status: 200 len: 1314 microversion: 2.1 time: 0.906458 Sep 06 01:14:22.495980 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 225/438] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:21 2022] GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff => generated 1314 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:22.519383 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-30627aee-c803-4ae6-bf57-0f5222be40a6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:22.522839 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-30627aee-c803-4ae6-bf57-0f5222be40a6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:22.552289 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-30627aee-c803-4ae6-bf57-0f5222be40a6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:22.552856 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-30627aee-c803-4ae6-bf57-0f5222be40a6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:22.553269 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-30627aee-c803-4ae6-bf57-0f5222be40a6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:22.554144 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-30627aee-c803-4ae6-bf57-0f5222be40a6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:22.554847 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-30627aee-c803-4ae6-bf57-0f5222be40a6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:22.555570 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-30627aee-c803-4ae6-bf57-0f5222be40a6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:22.560587 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-92ce626d-4e36-4719-bac3-46e331af79ff tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:22.578896 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-92ce626d-4e36-4719-bac3-46e331af79ff tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/7589d872-fdde-4504-b16e-1f16598c41d3" status: 200 len: 1308 microversion: 2.1 time: 0.281509 Sep 06 01:14:22.598083 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 214/439] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:22 2022] GET /compute/v2.1/servers/7589d872-fdde-4504-b16e-1f16598c41d3 => generated 1308 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:22.606447 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e049cff6-3088-4ee2-9562-770b17d489ab tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:14:22.607319 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e049cff6-3088-4ee2-9562-770b17d489ab tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:22.615815 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e049cff6-3088-4ee2-9562-770b17d489ab tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:22.616313 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e049cff6-3088-4ee2-9562-770b17d489ab tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:22.616751 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e049cff6-3088-4ee2-9562-770b17d489ab tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:22.618351 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e049cff6-3088-4ee2-9562-770b17d489ab tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:22.618875 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e049cff6-3088-4ee2-9562-770b17d489ab tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:22.619307 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e049cff6-3088-4ee2-9562-770b17d489ab tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:22.721863 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e049cff6-3088-4ee2-9562-770b17d489ab tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120581) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 06 01:14:22.730814 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-30627aee-c803-4ae6-bf57-0f5222be40a6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:22.744789 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-30627aee-c803-4ae6-bf57-0f5222be40a6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1304 microversion: 2.1 time: 0.247361 Sep 06 01:14:22.765380 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 226/440] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:22 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1304 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:22.775082 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-9871b9d1-528b-4fe5-a475-bb70b2e81760 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:22.780687 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-9871b9d1-528b-4fe5-a475-bb70b2e81760 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:22.789357 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:22.792686 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9871b9d1-528b-4fe5-a475-bb70b2e81760 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:22.794184 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9871b9d1-528b-4fe5-a475-bb70b2e81760 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:22.794795 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9871b9d1-528b-4fe5-a475-bb70b2e81760 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:22.806064 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9871b9d1-528b-4fe5-a475-bb70b2e81760 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:22.809276 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9871b9d1-528b-4fe5-a475-bb70b2e81760 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:22.811636 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9871b9d1-528b-4fe5-a475-bb70b2e81760 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:22.908279 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e049cff6-3088-4ee2-9562-770b17d489ab tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "POST /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125/action" status: 202 len: 0 microversion: 2.20 time: 0.306128 Sep 06 01:14:22.909691 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 215/441] 10.222.0.23 () {62 vars in 1319 bytes} [Tue Sep 6 01:14:22 2022] POST /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 01:14:22.931261 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-06ed3a47-2014-4085-a9d3-e11c9c5c9794 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:22.932243 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-06ed3a47-2014-4085-a9d3-e11c9c5c9794 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:22.962087 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-06ed3a47-2014-4085-a9d3-e11c9c5c9794 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:22.962606 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-06ed3a47-2014-4085-a9d3-e11c9c5c9794 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:22.963053 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-06ed3a47-2014-4085-a9d3-e11c9c5c9794 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:22.963811 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-06ed3a47-2014-4085-a9d3-e11c9c5c9794 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:22.964251 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-06ed3a47-2014-4085-a9d3-e11c9c5c9794 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:22.964671 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-06ed3a47-2014-4085-a9d3-e11c9c5c9794 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:23.176122 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:23.355858 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-9871b9d1-528b-4fe5-a475-bb70b2e81760 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:23.375428 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-9871b9d1-528b-4fe5-a475-bb70b2e81760 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5" status: 200 len: 1558 microversion: 2.1 time: 0.608512 Sep 06 01:14:23.397717 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 227/442] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:22 2022] GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5 => generated 1558 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:23.403014 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-06834571-1463-4cb1-b02e-ff1dcfec8b4a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:23.403519 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-06834571-1463-4cb1-b02e-ff1dcfec8b4a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:23.431993 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-06834571-1463-4cb1-b02e-ff1dcfec8b4a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:23.432761 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-06834571-1463-4cb1-b02e-ff1dcfec8b4a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:23.433392 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-06834571-1463-4cb1-b02e-ff1dcfec8b4a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:23.434257 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-06834571-1463-4cb1-b02e-ff1dcfec8b4a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:23.434890 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-06834571-1463-4cb1-b02e-ff1dcfec8b4a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:23.435463 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-06834571-1463-4cb1-b02e-ff1dcfec8b4a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:23.730642 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-06ed3a47-2014-4085-a9d3-e11c9c5c9794 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:23.747592 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-06ed3a47-2014-4085-a9d3-e11c9c5c9794 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:23.749780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-06ed3a47-2014-4085-a9d3-e11c9c5c9794 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:23.751484 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-06ed3a47-2014-4085-a9d3-e11c9c5c9794 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1751 microversion: 2.20 time: 0.830440 Sep 06 01:14:23.752446 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 216/443] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:14:22 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1751 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:14:23.762283 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cc1dd4be-526e-489f-ba4a-b155379d6d93 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:23.767522 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cc1dd4be-526e-489f-ba4a-b155379d6d93 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] [instance: dff4f970-9216-4d56-81d9-f62b12ebccff] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:23.780019 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc1dd4be-526e-489f-ba4a-b155379d6d93 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:23.783907 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc1dd4be-526e-489f-ba4a-b155379d6d93 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:23.784684 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc1dd4be-526e-489f-ba4a-b155379d6d93 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:23.785959 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc1dd4be-526e-489f-ba4a-b155379d6d93 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:23.789025 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc1dd4be-526e-489f-ba4a-b155379d6d93 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:23.789756 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc1dd4be-526e-489f-ba4a-b155379d6d93 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:23.800105 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-06834571-1463-4cb1-b02e-ff1dcfec8b4a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.400729 Sep 06 01:14:23.802029 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 228/444] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Sep 6 01:14:23 2022] GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5/os-interface => generated 284 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:14:23.807369 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-7febb660-4599-4e07-a62a-8f45fb7f7086 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:23.808366 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-7febb660-4599-4e07-a62a-8f45fb7f7086 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 7589d872-fdde-4504-b16e-1f16598c41d3] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:23.825189 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7febb660-4599-4e07-a62a-8f45fb7f7086 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:23.826096 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7febb660-4599-4e07-a62a-8f45fb7f7086 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:23.826778 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7febb660-4599-4e07-a62a-8f45fb7f7086 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:23.827887 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7febb660-4599-4e07-a62a-8f45fb7f7086 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:23.828585 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7febb660-4599-4e07-a62a-8f45fb7f7086 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:23.829232 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7febb660-4599-4e07-a62a-8f45fb7f7086 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:23.846000 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.wsgi [None req-7febb660-4599-4e07-a62a-8f45fb7f7086 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] HTTP exception thrown: Instance 7589d872-fdde-4504-b16e-1f16598c41d3 could not be found. Sep 06 01:14:23.848145 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-7febb660-4599-4e07-a62a-8f45fb7f7086 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Request method failure captured: Sep 06 01:14:23.848145 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: request: GET /compute/v2.1/servers/7589d872-fdde-4504-b16e-1f16598c41d3 HTTP/1.1 Sep 06 01:14:23.848145 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept: application/json Sep 06 01:14:23.848145 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept-Encoding: identity Sep 06 01:14:23.848145 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Connection: close Sep 06 01:14:23.848145 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Length: 0 Sep 06 01:14:23.848145 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Type: application/json Sep 06 01:14:23.848145 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Host: 10.222.0.23 Sep 06 01:14:23.848145 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Openstack-System-Scope: None Sep 06 01:14:23.848145 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: User-Agent: python-urllib3/1.26.12 Sep 06 01:14:23.848145 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Auth-Token: gAAAAABjFp5_S3ywqzVFLiOP_itLFSEGJZ7PtWCJjZCqJxzQc2BQO9SO2bKdXqIYrvPltuS1-NKKC38wB2c5qspESAwp9QoeTLdeSn26zq3nVL7uvB6EN7cayaD-4VccaXE7mWPNbCzv4KnNcNWge4a3md5dJxMQq4WV43Ai6DRsQOJdqb8grJY Sep 06 01:14:23.848145 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Id: None Sep 06 01:14:23.848145 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Name: None Sep 06 01:14:23.848145 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Identity-Status: Confirmed Sep 06 01:14:23.848145 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Is-Admin-Project: True Sep 06 01:14:23.848145 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Id: default Sep 06 01:14:23.848145 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Name: Default Sep 06 01:14:23.848145 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Id: d4d649e0b0434716b8d4aaf4ea171a8e Sep 06 01:14:23.848145 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1968721303 Sep 06 01:14:23.848145 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Role: reader,member Sep 06 01:14:23.848145 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Roles: reader,member Sep 06 01:14:23.849489 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d4d649e0b0434716b8d4aaf4ea171a8e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d4d649e0b0434716b8d4aaf4ea171a8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d4d649e0b0434716b8d4aaf4ea171a8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d4d649e0b0434716b8d4aaf4ea171a8e"}]}] Sep 06 01:14:23.849489 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant: tempest-VolumesSnapshotTestJSON-1968721303 Sep 06 01:14:23.849489 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Id: d4d649e0b0434716b8d4aaf4ea171a8e Sep 06 01:14:23.849489 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1968721303 Sep 06 01:14:23.849489 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User: tempest-VolumesSnapshotTestJSON-1968721303-project Sep 06 01:14:23.849489 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Id: default Sep 06 01:14:23.849489 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Name: Default Sep 06 01:14:23.849489 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Id: 2d2b7b4cb4a34964a4d6127a1ed3ac98 Sep 06 01:14:23.849489 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Name: tempest-VolumesSnapshotTestJSON-1968721303-project Sep 06 01:14:23.849489 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: method: > Sep 06 01:14:23.849489 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: exception: Instance 7589d872-fdde-4504-b16e-1f16598c41d3 could not be found. Sep 06 01:14:23.849489 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: action_args: {'id': '7589d872-fdde-4504-b16e-1f16598c41d3'} Sep 06 01:14:23.850213 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:14:23.850213 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:14:23.850213 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 01:14:23.850213 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 01:14:23.850213 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 01:14:23.850213 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 01:14:23.850213 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 01:14:23.850213 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 01:14:23.850213 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 01:14:23.850213 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 01:14:23.850213 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7589d872-fdde-4504-b16e-1f16598c41d3 could not be found. Sep 06 01:14:23.850213 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:14:23.850213 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:14:23.850213 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:14:23.850213 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:14:23.850213 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:14:23.850213 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:14:23.850213 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:14:23.850213 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:14:23.850213 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:14:23.851399 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:14:23.851399 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 01:14:23.851399 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 01:14:23.851399 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 01:14:23.851399 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 01:14:23.851399 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 01:14:23.851399 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:14:23.851399 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7589d872-fdde-4504-b16e-1f16598c41d3 could not be found. Sep 06 01:14:23.851399 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:14:23.851399 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:14:23.851399 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:14:23.851399 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:14:23.851399 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:14:23.851399 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:14:23.851399 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:14:23.851399 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:14:23.851399 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7589d872-fdde-4504-b16e-1f16598c41d3 could not be found. Sep 06 01:14:23.851399 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:14:23.867736 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-7febb660-4599-4e07-a62a-8f45fb7f7086 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Returning 404 to user: Instance 7589d872-fdde-4504-b16e-1f16598c41d3 could not be found. {{(pid=120580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:14:23.869116 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-7febb660-4599-4e07-a62a-8f45fb7f7086 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/7589d872-fdde-4504-b16e-1f16598c41d3" status: 404 len: 111 microversion: 2.1 time: 0.065845 Sep 06 01:14:23.870340 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 229/445] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:23 2022] GET /compute/v2.1/servers/7589d872-fdde-4504-b16e-1f16598c41d3 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 01:14:23.887959 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-69162f8a-a649-4fec-839e-2345b4621f6c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:23.889049 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-69162f8a-a649-4fec-839e-2345b4621f6c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:23.891666 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell0:SELECT=2 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:23.904191 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=8 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:23.911952 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-69162f8a-a649-4fec-839e-2345b4621f6c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:23.913197 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-69162f8a-a649-4fec-839e-2345b4621f6c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:23.914233 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-69162f8a-a649-4fec-839e-2345b4621f6c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:23.915506 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-69162f8a-a649-4fec-839e-2345b4621f6c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:23.916453 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-69162f8a-a649-4fec-839e-2345b4621f6c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:23.917115 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-69162f8a-a649-4fec-839e-2345b4621f6c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:24.160110 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-69162f8a-a649-4fec-839e-2345b4621f6c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:24.177634 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-69162f8a-a649-4fec-839e-2345b4621f6c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1304 microversion: 2.1 time: 0.298053 Sep 06 01:14:24.178952 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 230/446] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:23 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1304 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:24.415902 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-b9a7b02c-dcc5-4618-aa91-ebe48896bded req-eb0c902c-ecf9-4680-ba44-423f2b490989 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dff4f970-9216-4d56-81d9-f62b12ebccff", "tag": "e361c831-ec99-4391-ba22-77ddd7f8862c"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:14:24.451964 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell0:SELECT=12 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:24.460243 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-b9a7b02c-dcc5-4618-aa91-ebe48896bded req-eb0c902c-ecf9-4680-ba44-423f2b490989 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:24.460722 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-b9a7b02c-dcc5-4618-aa91-ebe48896bded req-eb0c902c-ecf9-4680-ba44-423f2b490989 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:24.461151 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-b9a7b02c-dcc5-4618-aa91-ebe48896bded req-eb0c902c-ecf9-4680-ba44-423f2b490989 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:24.494085 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.compute.server_external_events [req-b9a7b02c-dcc5-4618-aa91-ebe48896bded req-eb0c902c-ecf9-4680-ba44-423f2b490989 service nova] Creating event network-changed:e361c831-ec99-4391-ba22-77ddd7f8862c for instance dff4f970-9216-4d56-81d9-f62b12ebccff on hv-cinder-84773 Sep 06 01:14:24.501627 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [req-b9a7b02c-dcc5-4618-aa91-ebe48896bded req-eb0c902c-ecf9-4680-ba44-423f2b490989 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091384 Sep 06 01:14:24.503007 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 231/447] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:14:24.788612 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-ae9d047c-8aa8-47b2-a6cd-814933f0d547 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:24.790041 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-ae9d047c-8aa8-47b2-a6cd-814933f0d547 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:24.808296 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ae9d047c-8aa8-47b2-a6cd-814933f0d547 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:24.808901 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ae9d047c-8aa8-47b2-a6cd-814933f0d547 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:24.809200 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ae9d047c-8aa8-47b2-a6cd-814933f0d547 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:24.812340 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ae9d047c-8aa8-47b2-a6cd-814933f0d547 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:24.815610 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ae9d047c-8aa8-47b2-a6cd-814933f0d547 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:24.819521 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ae9d047c-8aa8-47b2-a6cd-814933f0d547 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:25.090804 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-cc1dd4be-526e-489f-ba4a-b155379d6d93 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c48bdc1644230a97a6d9b8fe8f9f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd22b3b78f416ab10fd92ac92a5589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:25.113763 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cc1dd4be-526e-489f-ba4a-b155379d6d93 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] 10.222.0.23 "GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff" status: 200 len: 1314 microversion: 2.1 time: 1.357973 Sep 06 01:14:25.115188 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 217/448] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:23 2022] GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff => generated 1314 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:25.202390 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-083cf7b6-39b2-4dd4-a432-0724456ef163 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:25.203288 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-083cf7b6-39b2-4dd4-a432-0724456ef163 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:25.211349 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-083cf7b6-39b2-4dd4-a432-0724456ef163 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:25.224584 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-083cf7b6-39b2-4dd4-a432-0724456ef163 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:25.225315 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-083cf7b6-39b2-4dd4-a432-0724456ef163 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:25.226225 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-083cf7b6-39b2-4dd4-a432-0724456ef163 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:25.226830 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-083cf7b6-39b2-4dd4-a432-0724456ef163 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:25.227502 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-083cf7b6-39b2-4dd4-a432-0724456ef163 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:25.274756 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-ae9d047c-8aa8-47b2-a6cd-814933f0d547 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:25.290186 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-ae9d047c-8aa8-47b2-a6cd-814933f0d547 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:25.292240 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-ae9d047c-8aa8-47b2-a6cd-814933f0d547 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:25.294269 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-ae9d047c-8aa8-47b2-a6cd-814933f0d547 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1751 microversion: 2.20 time: 0.517197 Sep 06 01:14:25.295587 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 232/449] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:14:24 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1751 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:14:25.521292 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-083cf7b6-39b2-4dd4-a432-0724456ef163 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:25.524834 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:25.530419 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-083cf7b6-39b2-4dd4-a432-0724456ef163 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1372 microversion: 2.1 time: 0.331784 Sep 06 01:14:25.544193 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 218/450] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:25 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1372 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:26.143062 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-6a7fb6d1-a33d-4a27-9d37-c1058bdaf20c tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:26.144375 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-6a7fb6d1-a33d-4a27-9d37-c1058bdaf20c tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] [instance: dff4f970-9216-4d56-81d9-f62b12ebccff] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:26.159050 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6a7fb6d1-a33d-4a27-9d37-c1058bdaf20c tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:26.163041 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6a7fb6d1-a33d-4a27-9d37-c1058bdaf20c tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:26.163538 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6a7fb6d1-a33d-4a27-9d37-c1058bdaf20c tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:26.164606 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6a7fb6d1-a33d-4a27-9d37-c1058bdaf20c tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:26.164753 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6a7fb6d1-a33d-4a27-9d37-c1058bdaf20c tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:26.168367 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6a7fb6d1-a33d-4a27-9d37-c1058bdaf20c tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:26.266802 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-e82a59aa-cdb6-4fdc-a04f-34f4085ee618 req-911517fd-77b8-48e7-9dd6-e3d515fa7fdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9a2a405-dce3-4320-b44d-a19c556501b5", "tag": "1d34bce1-fa87-41f6-98ae-7a1f148c1081"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:14:26.289164 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e82a59aa-cdb6-4fdc-a04f-34f4085ee618 req-911517fd-77b8-48e7-9dd6-e3d515fa7fdc service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:26.289644 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e82a59aa-cdb6-4fdc-a04f-34f4085ee618 req-911517fd-77b8-48e7-9dd6-e3d515fa7fdc service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:26.290069 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e82a59aa-cdb6-4fdc-a04f-34f4085ee618 req-911517fd-77b8-48e7-9dd6-e3d515fa7fdc service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:26.323672 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-e82a59aa-cdb6-4fdc-a04f-34f4085ee618 req-911517fd-77b8-48e7-9dd6-e3d515fa7fdc service nova] Creating event network-changed:1d34bce1-fa87-41f6-98ae-7a1f148c1081 for instance f9a2a405-dce3-4320-b44d-a19c556501b5 on hv-cinder-84773 Sep 06 01:14:26.333962 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-e82a59aa-cdb6-4fdc-a04f-34f4085ee618 req-911517fd-77b8-48e7-9dd6-e3d515fa7fdc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070633 Sep 06 01:14:26.334565 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 219/451] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 01:14:26.345505 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9bd3527f-e2ed-4416-b735-50caa70aaaf1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:26.350886 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9bd3527f-e2ed-4416-b735-50caa70aaaf1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:26.366634 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9bd3527f-e2ed-4416-b735-50caa70aaaf1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:26.372438 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9bd3527f-e2ed-4416-b735-50caa70aaaf1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:26.373123 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9bd3527f-e2ed-4416-b735-50caa70aaaf1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:26.374015 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9bd3527f-e2ed-4416-b735-50caa70aaaf1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:26.374621 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9bd3527f-e2ed-4416-b735-50caa70aaaf1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:26.375201 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9bd3527f-e2ed-4416-b735-50caa70aaaf1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:26.441628 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-6a7fb6d1-a33d-4a27-9d37-c1058bdaf20c tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c48bdc1644230a97a6d9b8fe8f9f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd22b3b78f416ab10fd92ac92a5589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:26.456792 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-6a7fb6d1-a33d-4a27-9d37-c1058bdaf20c tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] 10.222.0.23 "GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff" status: 200 len: 1314 microversion: 2.1 time: 0.320954 Sep 06 01:14:26.463721 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 233/452] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:26 2022] GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:26.557846 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-2e13fff9-d561-4cea-b178-f2fcfcd8a426 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:26.558482 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-2e13fff9-d561-4cea-b178-f2fcfcd8a426 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:26.592343 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2e13fff9-d561-4cea-b178-f2fcfcd8a426 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:26.593019 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2e13fff9-d561-4cea-b178-f2fcfcd8a426 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:26.594638 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2e13fff9-d561-4cea-b178-f2fcfcd8a426 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:26.595412 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2e13fff9-d561-4cea-b178-f2fcfcd8a426 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:26.595925 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2e13fff9-d561-4cea-b178-f2fcfcd8a426 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:26.596358 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2e13fff9-d561-4cea-b178-f2fcfcd8a426 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:26.914370 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-9bd3527f-e2ed-4416-b735-50caa70aaaf1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:26.936108 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-9bd3527f-e2ed-4416-b735-50caa70aaaf1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:26.942908 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-9bd3527f-e2ed-4416-b735-50caa70aaaf1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:26.949874 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9bd3527f-e2ed-4416-b735-50caa70aaaf1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1751 microversion: 2.20 time: 0.609243 Sep 06 01:14:26.952687 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 220/453] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:14:26 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1751 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:14:27.034757 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-2e13fff9-d561-4cea-b178-f2fcfcd8a426 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:27.049500 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-2e13fff9-d561-4cea-b178-f2fcfcd8a426 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1372 microversion: 2.1 time: 0.498929 Sep 06 01:14:27.050214 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 234/454] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:26 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1372 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:27.482565 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b183c9ef-eaee-4e46-a402-55ffdefde9ba tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:27.487588 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b183c9ef-eaee-4e46-a402-55ffdefde9ba tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] [instance: dff4f970-9216-4d56-81d9-f62b12ebccff] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:27.500489 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b183c9ef-eaee-4e46-a402-55ffdefde9ba tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:27.503254 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b183c9ef-eaee-4e46-a402-55ffdefde9ba tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:27.505739 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b183c9ef-eaee-4e46-a402-55ffdefde9ba tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:27.537787 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b183c9ef-eaee-4e46-a402-55ffdefde9ba tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:27.542373 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b183c9ef-eaee-4e46-a402-55ffdefde9ba tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.036s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:27.543317 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b183c9ef-eaee-4e46-a402-55ffdefde9ba tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:27.987468 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-874dc5b9-26c4-4649-9e68-b81ddbd670eb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:27.990452 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-874dc5b9-26c4-4649-9e68-b81ddbd670eb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:28.013255 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-874dc5b9-26c4-4649-9e68-b81ddbd670eb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:28.014892 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-874dc5b9-26c4-4649-9e68-b81ddbd670eb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:28.015397 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-874dc5b9-26c4-4649-9e68-b81ddbd670eb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:28.016236 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-874dc5b9-26c4-4649-9e68-b81ddbd670eb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:28.016757 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-874dc5b9-26c4-4649-9e68-b81ddbd670eb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:28.017269 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-874dc5b9-26c4-4649-9e68-b81ddbd670eb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:28.250935 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-b183c9ef-eaee-4e46-a402-55ffdefde9ba tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c48bdc1644230a97a6d9b8fe8f9f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd22b3b78f416ab10fd92ac92a5589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:28.260493 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b183c9ef-eaee-4e46-a402-55ffdefde9ba tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] 10.222.0.23 "GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff" status: 200 len: 1314 microversion: 2.1 time: 0.781686 Sep 06 01:14:28.268958 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 221/455] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:27 2022] GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff => generated 1314 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:28.274438 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a8dcb828-d8e7-485d-84d4-8368df3ff82c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:28.280725 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a8dcb828-d8e7-485d-84d4-8368df3ff82c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:28.299413 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8dcb828-d8e7-485d-84d4-8368df3ff82c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:28.303224 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8dcb828-d8e7-485d-84d4-8368df3ff82c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:28.303897 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8dcb828-d8e7-485d-84d4-8368df3ff82c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:28.307213 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8dcb828-d8e7-485d-84d4-8368df3ff82c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:28.307708 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8dcb828-d8e7-485d-84d4-8368df3ff82c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:28.308365 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8dcb828-d8e7-485d-84d4-8368df3ff82c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:28.372663 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-874dc5b9-26c4-4649-9e68-b81ddbd670eb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:28.401366 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-874dc5b9-26c4-4649-9e68-b81ddbd670eb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:28.407373 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-874dc5b9-26c4-4649-9e68-b81ddbd670eb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:28.415003 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-874dc5b9-26c4-4649-9e68-b81ddbd670eb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1753 microversion: 2.20 time: 0.439283 Sep 06 01:14:28.416742 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 235/456] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:14:27 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1753 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:14:29.006691 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-a8dcb828-d8e7-485d-84d4-8368df3ff82c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:29.020837 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a8dcb828-d8e7-485d-84d4-8368df3ff82c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1372 microversion: 2.1 time: 0.749355 Sep 06 01:14:29.029315 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 222/457] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:28 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1372 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:29.292658 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-2a348b4f-1ff6-4ce9-ac11-058f1984c155 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:29.293538 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-2a348b4f-1ff6-4ce9-ac11-058f1984c155 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] [instance: dff4f970-9216-4d56-81d9-f62b12ebccff] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:29.310384 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2a348b4f-1ff6-4ce9-ac11-058f1984c155 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:29.320786 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2a348b4f-1ff6-4ce9-ac11-058f1984c155 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:29.323533 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2a348b4f-1ff6-4ce9-ac11-058f1984c155 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:29.324770 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2a348b4f-1ff6-4ce9-ac11-058f1984c155 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:29.326776 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2a348b4f-1ff6-4ce9-ac11-058f1984c155 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:29.327228 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2a348b4f-1ff6-4ce9-ac11-058f1984c155 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:29.443703 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-000b3f82-8c73-46de-a936-0f94763b92d2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:29.444338 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-000b3f82-8c73-46de-a936-0f94763b92d2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:29.455898 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-000b3f82-8c73-46de-a936-0f94763b92d2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:29.461590 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-000b3f82-8c73-46de-a936-0f94763b92d2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:29.462053 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-000b3f82-8c73-46de-a936-0f94763b92d2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:29.462795 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-000b3f82-8c73-46de-a936-0f94763b92d2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:29.463259 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-000b3f82-8c73-46de-a936-0f94763b92d2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:29.463690 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-000b3f82-8c73-46de-a936-0f94763b92d2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:29.657882 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-2a348b4f-1ff6-4ce9-ac11-058f1984c155 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c48bdc1644230a97a6d9b8fe8f9f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd22b3b78f416ab10fd92ac92a5589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:29.674839 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-2a348b4f-1ff6-4ce9-ac11-058f1984c155 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] 10.222.0.23 "GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff" status: 200 len: 1314 microversion: 2.1 time: 0.386081 Sep 06 01:14:29.675412 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 236/458] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:29 2022] GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:29.693500 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-1a24e3d9-61cc-4939-8a0e-79bec5b38d6f req-f1466c29-5972-4b94-a0a3-25e6466b7163 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce3f054d-45b3-41c2-9f87-c32efa7bc088", "tag": "5bfb66f4-238b-4ee5-8ff6-581b693fd4eb"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:14:29.706639 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-1a24e3d9-61cc-4939-8a0e-79bec5b38d6f req-f1466c29-5972-4b94-a0a3-25e6466b7163 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:29.707117 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-1a24e3d9-61cc-4939-8a0e-79bec5b38d6f req-f1466c29-5972-4b94-a0a3-25e6466b7163 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:29.707611 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-1a24e3d9-61cc-4939-8a0e-79bec5b38d6f req-f1466c29-5972-4b94-a0a3-25e6466b7163 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:29.711645 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell1:SELECT=100 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:29.731117 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.compute.server_external_events [req-1a24e3d9-61cc-4939-8a0e-79bec5b38d6f req-f1466c29-5972-4b94-a0a3-25e6466b7163 service nova] Creating event network-changed:5bfb66f4-238b-4ee5-8ff6-581b693fd4eb for instance ce3f054d-45b3-41c2-9f87-c32efa7bc088 on hv-cinder-84773 Sep 06 01:14:29.745514 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [req-1a24e3d9-61cc-4939-8a0e-79bec5b38d6f req-f1466c29-5972-4b94-a0a3-25e6466b7163 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056035 Sep 06 01:14:29.752912 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 237/459] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 01:14:29.845898 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-000b3f82-8c73-46de-a936-0f94763b92d2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:29.859313 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-000b3f82-8c73-46de-a936-0f94763b92d2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:29.867455 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-000b3f82-8c73-46de-a936-0f94763b92d2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:29.872332 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-000b3f82-8c73-46de-a936-0f94763b92d2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1809 microversion: 2.20 time: 0.433508 Sep 06 01:14:29.883852 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 223/460] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:14:29 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1809 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:14:30.087629 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-cab4022e-002b-4c17-a270-1b708cbd2e78 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:30.094129 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-cab4022e-002b-4c17-a270-1b708cbd2e78 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:30.118694 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cab4022e-002b-4c17-a270-1b708cbd2e78 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:30.120833 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cab4022e-002b-4c17-a270-1b708cbd2e78 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:30.123699 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cab4022e-002b-4c17-a270-1b708cbd2e78 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:30.128312 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cab4022e-002b-4c17-a270-1b708cbd2e78 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:30.132471 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cab4022e-002b-4c17-a270-1b708cbd2e78 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:30.134196 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cab4022e-002b-4c17-a270-1b708cbd2e78 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:30.671363 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a923dd95-9826-4921-b253-1c7a4e38e570 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:30.673949 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a923dd95-9826-4921-b253-1c7a4e38e570 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:30.704945 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a923dd95-9826-4921-b253-1c7a4e38e570 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:30.708585 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a923dd95-9826-4921-b253-1c7a4e38e570 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:30.709060 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a923dd95-9826-4921-b253-1c7a4e38e570 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:30.715187 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a923dd95-9826-4921-b253-1c7a4e38e570 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:30.731066 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a923dd95-9826-4921-b253-1c7a4e38e570 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:30.731849 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a923dd95-9826-4921-b253-1c7a4e38e570 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:30.766803 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a923dd95-9826-4921-b253-1c7a4e38e570 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba/ips" status: 200 len: 145 microversion: 2.1 time: 0.108451 Sep 06 01:14:30.768660 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 224/461] 10.222.0.23 () {58 vars in 1248 bytes} [Tue Sep 6 01:14:30 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba/ips => generated 145 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:14:30.773653 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-827f4ca3-31da-4f2d-a32d-67721e100636 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:30.774580 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-827f4ca3-31da-4f2d-a32d-67721e100636 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] [instance: dff4f970-9216-4d56-81d9-f62b12ebccff] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:30.788552 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-827f4ca3-31da-4f2d-a32d-67721e100636 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:30.789392 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-827f4ca3-31da-4f2d-a32d-67721e100636 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:30.790079 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-827f4ca3-31da-4f2d-a32d-67721e100636 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:30.791051 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-827f4ca3-31da-4f2d-a32d-67721e100636 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:30.791733 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-827f4ca3-31da-4f2d-a32d-67721e100636 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:30.792497 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-827f4ca3-31da-4f2d-a32d-67721e100636 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:31.200632 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-cab4022e-002b-4c17-a270-1b708cbd2e78 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:31.210186 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-cab4022e-002b-4c17-a270-1b708cbd2e78 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1372 microversion: 2.1 time: 1.151446 Sep 06 01:14:31.240344 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 238/462] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:30 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1372 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:31.253121 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-be3d6f3c-2d64-4db2-b4e7-4a3f25cce588 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:31.255389 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-be3d6f3c-2d64-4db2-b4e7-4a3f25cce588 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:31.271843 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-be3d6f3c-2d64-4db2-b4e7-4a3f25cce588 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:31.272838 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-be3d6f3c-2d64-4db2-b4e7-4a3f25cce588 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:31.277144 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-be3d6f3c-2d64-4db2-b4e7-4a3f25cce588 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:31.277896 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-be3d6f3c-2d64-4db2-b4e7-4a3f25cce588 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:31.281468 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-be3d6f3c-2d64-4db2-b4e7-4a3f25cce588 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:31.281947 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-be3d6f3c-2d64-4db2-b4e7-4a3f25cce588 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:31.429075 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-827f4ca3-31da-4f2d-a32d-67721e100636 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c48bdc1644230a97a6d9b8fe8f9f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd22b3b78f416ab10fd92ac92a5589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:31.437365 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-827f4ca3-31da-4f2d-a32d-67721e100636 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] 10.222.0.23 "GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff" status: 200 len: 1314 microversion: 2.1 time: 0.667488 Sep 06 01:14:31.448591 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 225/463] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:30 2022] GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff => generated 1314 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:31.528144 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-be3d6f3c-2d64-4db2-b4e7-4a3f25cce588 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:31.538649 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-be3d6f3c-2d64-4db2-b4e7-4a3f25cce588 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:31.540153 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-be3d6f3c-2d64-4db2-b4e7-4a3f25cce588 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:31.541310 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-be3d6f3c-2d64-4db2-b4e7-4a3f25cce588 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1809 microversion: 2.20 time: 0.298922 Sep 06 01:14:31.542230 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 239/464] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:14:31 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1809 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:14:32.235845 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b7e3dba3-7f3a-40b5-be84-6861c24bc157 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:32.236603 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b7e3dba3-7f3a-40b5-be84-6861c24bc157 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:32.247102 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7e3dba3-7f3a-40b5-be84-6861c24bc157 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:32.247593 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7e3dba3-7f3a-40b5-be84-6861c24bc157 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:32.248055 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7e3dba3-7f3a-40b5-be84-6861c24bc157 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:32.248756 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7e3dba3-7f3a-40b5-be84-6861c24bc157 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:32.251769 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7e3dba3-7f3a-40b5-be84-6861c24bc157 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:32.252205 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7e3dba3-7f3a-40b5-be84-6861c24bc157 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:32.463141 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-1a24af0e-6181-48e3-bd4b-8dabd7babc7c tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:32.463968 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-1a24af0e-6181-48e3-bd4b-8dabd7babc7c tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] [instance: dff4f970-9216-4d56-81d9-f62b12ebccff] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:32.470663 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1a24af0e-6181-48e3-bd4b-8dabd7babc7c tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:32.471222 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1a24af0e-6181-48e3-bd4b-8dabd7babc7c tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:32.471727 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1a24af0e-6181-48e3-bd4b-8dabd7babc7c tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:32.472503 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1a24af0e-6181-48e3-bd4b-8dabd7babc7c tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:32.473019 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1a24af0e-6181-48e3-bd4b-8dabd7babc7c tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:32.473714 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1a24af0e-6181-48e3-bd4b-8dabd7babc7c tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:32.517752 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-b7e3dba3-7f3a-40b5-be84-6861c24bc157 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:32.526784 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b7e3dba3-7f3a-40b5-be84-6861c24bc157 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1372 microversion: 2.1 time: 0.294598 Sep 06 01:14:32.535935 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 226/465] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:32 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1372 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:32.571521 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-abc0bdd1-ed48-4eaa-ae8e-9d35f8a8cd3b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:32.578466 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-abc0bdd1-ed48-4eaa-ae8e-9d35f8a8cd3b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:32.582026 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:32.586270 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abc0bdd1-ed48-4eaa-ae8e-9d35f8a8cd3b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:32.586787 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abc0bdd1-ed48-4eaa-ae8e-9d35f8a8cd3b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:32.587675 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abc0bdd1-ed48-4eaa-ae8e-9d35f8a8cd3b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:32.588294 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abc0bdd1-ed48-4eaa-ae8e-9d35f8a8cd3b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:32.588844 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abc0bdd1-ed48-4eaa-ae8e-9d35f8a8cd3b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:32.590016 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abc0bdd1-ed48-4eaa-ae8e-9d35f8a8cd3b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:32.772906 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-1a24af0e-6181-48e3-bd4b-8dabd7babc7c tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c48bdc1644230a97a6d9b8fe8f9f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd22b3b78f416ab10fd92ac92a5589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:32.791854 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-1a24af0e-6181-48e3-bd4b-8dabd7babc7c tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] 10.222.0.23 "GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff" status: 200 len: 1314 microversion: 2.1 time: 0.334220 Sep 06 01:14:32.792993 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 240/466] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:32 2022] GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:32.806432 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-abc0bdd1-ed48-4eaa-ae8e-9d35f8a8cd3b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:32.820200 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-abc0bdd1-ed48-4eaa-ae8e-9d35f8a8cd3b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:32.823188 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-abc0bdd1-ed48-4eaa-ae8e-9d35f8a8cd3b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:32.826411 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-abc0bdd1-ed48-4eaa-ae8e-9d35f8a8cd3b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1809 microversion: 2.20 time: 0.260892 Sep 06 01:14:32.827463 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 227/467] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:14:32 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1809 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:14:33.550550 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-c3734fcb-5a1e-47c8-9772-cc28b424a8cd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:33.552242 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-c3734fcb-5a1e-47c8-9772-cc28b424a8cd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:33.566084 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c3734fcb-5a1e-47c8-9772-cc28b424a8cd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:33.566713 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c3734fcb-5a1e-47c8-9772-cc28b424a8cd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:33.567390 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c3734fcb-5a1e-47c8-9772-cc28b424a8cd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:33.568133 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c3734fcb-5a1e-47c8-9772-cc28b424a8cd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:33.568730 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c3734fcb-5a1e-47c8-9772-cc28b424a8cd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:33.569236 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c3734fcb-5a1e-47c8-9772-cc28b424a8cd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:33.736901 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-c3734fcb-5a1e-47c8-9772-cc28b424a8cd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:33.760242 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-c3734fcb-5a1e-47c8-9772-cc28b424a8cd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1372 microversion: 2.1 time: 0.213544 Sep 06 01:14:33.792260 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 241/468] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:33 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1372 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:33.816341 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e45a4869-d7f2-4da8-b25f-b2c728a63b07 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:33.817493 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e45a4869-d7f2-4da8-b25f-b2c728a63b07 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] [instance: dff4f970-9216-4d56-81d9-f62b12ebccff] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:33.824720 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e45a4869-d7f2-4da8-b25f-b2c728a63b07 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:33.825207 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e45a4869-d7f2-4da8-b25f-b2c728a63b07 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:33.825657 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e45a4869-d7f2-4da8-b25f-b2c728a63b07 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:33.826341 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e45a4869-d7f2-4da8-b25f-b2c728a63b07 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:33.826825 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e45a4869-d7f2-4da8-b25f-b2c728a63b07 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:33.827248 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e45a4869-d7f2-4da8-b25f-b2c728a63b07 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:33.853888 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-a7fc8b43-46a6-49f0-bdab-f9fb2c3b877d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:33.854791 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-a7fc8b43-46a6-49f0-bdab-f9fb2c3b877d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:33.863900 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a7fc8b43-46a6-49f0-bdab-f9fb2c3b877d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:33.864619 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a7fc8b43-46a6-49f0-bdab-f9fb2c3b877d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:33.865227 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a7fc8b43-46a6-49f0-bdab-f9fb2c3b877d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:33.867073 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a7fc8b43-46a6-49f0-bdab-f9fb2c3b877d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:33.867983 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a7fc8b43-46a6-49f0-bdab-f9fb2c3b877d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:33.868562 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a7fc8b43-46a6-49f0-bdab-f9fb2c3b877d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:34.189811 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-e45a4869-d7f2-4da8-b25f-b2c728a63b07 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c48bdc1644230a97a6d9b8fe8f9f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd22b3b78f416ab10fd92ac92a5589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:34.192660 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-a7fc8b43-46a6-49f0-bdab-f9fb2c3b877d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:34.204863 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e45a4869-d7f2-4da8-b25f-b2c728a63b07 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] 10.222.0.23 "GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff" status: 200 len: 1314 microversion: 2.1 time: 0.393525 Sep 06 01:14:34.208936 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-a7fc8b43-46a6-49f0-bdab-f9fb2c3b877d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:34.213900 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-a7fc8b43-46a6-49f0-bdab-f9fb2c3b877d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:34.216056 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-a7fc8b43-46a6-49f0-bdab-f9fb2c3b877d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1809 microversion: 2.20 time: 0.365882 Sep 06 01:14:34.217117 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 242/470] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:14:33 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1809 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:14:34.217229 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 228/470] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:33 2022] GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:34.789206 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d64ee0a3-c993-47b7-bf6d-9c381f6d5d8f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:34.790031 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d64ee0a3-c993-47b7-bf6d-9c381f6d5d8f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:34.803126 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d64ee0a3-c993-47b7-bf6d-9c381f6d5d8f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:34.803679 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d64ee0a3-c993-47b7-bf6d-9c381f6d5d8f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:34.804155 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d64ee0a3-c993-47b7-bf6d-9c381f6d5d8f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:34.804896 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d64ee0a3-c993-47b7-bf6d-9c381f6d5d8f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:34.805357 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d64ee0a3-c993-47b7-bf6d-9c381f6d5d8f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:34.805787 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d64ee0a3-c993-47b7-bf6d-9c381f6d5d8f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:35.027934 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-d64ee0a3-c993-47b7-bf6d-9c381f6d5d8f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:35.047351 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d64ee0a3-c993-47b7-bf6d-9c381f6d5d8f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1372 microversion: 2.1 time: 0.258218 Sep 06 01:14:35.048239 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 229/471] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:34 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1372 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:35.087582 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-d370de19-8a6a-4fd3-be81-6fc4f5c5dfdd tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-164417090", "imageRef": "768973cc-7b5f-4eed-b493-e40eb0de9f88", "flavorRef": "452", "networks": [{"uuid": "78c9ee1a-8290-442d-a129-7d8287d9342b"}]}} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:14:35.171920 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.network.neutron [None req-d370de19-8a6a-4fd3-be81-6fc4f5c5dfdd tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] validate_networks() for [('78c9ee1a-8290-442d-a129-7d8287d9342b', None, None, None, None, None)] {{(pid=120580) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 01:14:35.229691 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cd80b6a9-74d6-4575-ba7d-c1f04528b8bb tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:35.230419 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cd80b6a9-74d6-4575-ba7d-c1f04528b8bb tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] [instance: dff4f970-9216-4d56-81d9-f62b12ebccff] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:35.239620 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cd80b6a9-74d6-4575-ba7d-c1f04528b8bb tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:35.240275 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cd80b6a9-74d6-4575-ba7d-c1f04528b8bb tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:35.243274 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cd80b6a9-74d6-4575-ba7d-c1f04528b8bb tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:35.244160 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cd80b6a9-74d6-4575-ba7d-c1f04528b8bb tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:35.244981 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cd80b6a9-74d6-4575-ba7d-c1f04528b8bb tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:35.245639 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cd80b6a9-74d6-4575-ba7d-c1f04528b8bb tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:35.530361 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-cd80b6a9-74d6-4575-ba7d-c1f04528b8bb tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c48bdc1644230a97a6d9b8fe8f9f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd22b3b78f416ab10fd92ac92a5589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:35.552211 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cd80b6a9-74d6-4575-ba7d-c1f04528b8bb tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] 10.222.0.23 "GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff" status: 200 len: 1314 microversion: 2.1 time: 0.326868 Sep 06 01:14:35.555409 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 230/472] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:35 2022] GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:35.589143 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-105b8c36-fd76-4d59-a33e-201b7d573e97 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:35.591035 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-105b8c36-fd76-4d59-a33e-201b7d573e97 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:35.610495 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-105b8c36-fd76-4d59-a33e-201b7d573e97 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:35.611001 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-105b8c36-fd76-4d59-a33e-201b7d573e97 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:35.611495 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-105b8c36-fd76-4d59-a33e-201b7d573e97 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:35.612239 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-105b8c36-fd76-4d59-a33e-201b7d573e97 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:35.612698 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-105b8c36-fd76-4d59-a33e-201b7d573e97 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:35.613134 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-105b8c36-fd76-4d59-a33e-201b7d573e97 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:35.976558 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-105b8c36-fd76-4d59-a33e-201b7d573e97 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:35.997557 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-105b8c36-fd76-4d59-a33e-201b7d573e97 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:35.998933 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-105b8c36-fd76-4d59-a33e-201b7d573e97 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:36.000159 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-105b8c36-fd76-4d59-a33e-201b7d573e97 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1809 microversion: 2.20 time: 0.441773 Sep 06 01:14:36.000709 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 231/473] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:14:35 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1809 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:14:36.020361 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4c9717cc-41f2-4661-b757-137c715013ed tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61041f52-8036-427c-a097-54f76913424c"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:14:36.026275 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4c9717cc-41f2-4661-b757-137c715013ed tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:36.040468 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-d370de19-8a6a-4fd3-be81-6fc4f5c5dfdd tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Flavor limits 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 01:14:36.040612 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c9717cc-41f2-4661-b757-137c715013ed tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:36.041037 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-d370de19-8a6a-4fd3-be81-6fc4f5c5dfdd tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Image limits 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 01:14:36.041143 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c9717cc-41f2-4661-b757-137c715013ed tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:36.041712 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-d370de19-8a6a-4fd3-be81-6fc4f5c5dfdd tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Flavor pref 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 01:14:36.041930 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c9717cc-41f2-4661-b757-137c715013ed tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:36.042288 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-d370de19-8a6a-4fd3-be81-6fc4f5c5dfdd tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Image pref 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 01:14:36.042582 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-d370de19-8a6a-4fd3-be81-6fc4f5c5dfdd tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 01:14:36.043660 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c9717cc-41f2-4661-b757-137c715013ed tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:36.044311 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c9717cc-41f2-4661-b757-137c715013ed tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:36.045240 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c9717cc-41f2-4661-b757-137c715013ed tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:36.058250 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d370de19-8a6a-4fd3-be81-6fc4f5c5dfdd tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:36.058748 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d370de19-8a6a-4fd3-be81-6fc4f5c5dfdd tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:36.059187 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d370de19-8a6a-4fd3-be81-6fc4f5c5dfdd tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:36.060134 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d370de19-8a6a-4fd3-be81-6fc4f5c5dfdd tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:36.060813 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d370de19-8a6a-4fd3-be81-6fc4f5c5dfdd tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:36.061681 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d370de19-8a6a-4fd3-be81-6fc4f5c5dfdd tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:36.088689 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.quota [None req-d370de19-8a6a-4fd3-be81-6fc4f5c5dfdd tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Getting quotas for project d4d649e0b0434716b8d4aaf4ea171a8e. Resources: {'instances', 'ram', 'cores'} {{(pid=120580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 01:14:36.094827 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.quota [None req-d370de19-8a6a-4fd3-be81-6fc4f5c5dfdd tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Getting quotas for user 2d2b7b4cb4a34964a4d6127a1ed3ac98 and project d4d649e0b0434716b8d4aaf4ea171a8e. Resources: {'instances', 'ram', 'cores'} {{(pid=120580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 01:14:36.112159 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-d370de19-8a6a-4fd3-be81-6fc4f5c5dfdd tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Going to run 1 instances... {{(pid=120580) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 01:14:36.115879 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-d370de19-8a6a-4fd3-be81-6fc4f5c5dfdd tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 70d2092a-968f-45aa-a07c-ee3b6f1a918e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='768973cc-7b5f-4eed-b493-e40eb0de9f88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 01:14:36.178984 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-d370de19-8a6a-4fd3-be81-6fc4f5c5dfdd tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.096278 Sep 06 01:14:36.180646 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 243/474] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Sep 6 01:14:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1099 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 01:14:36.186159 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-1e8500e6-1957-4291-801f-bc19f8b53e58 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:36.187422 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-1e8500e6-1957-4291-801f-bc19f8b53e58 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:36.198849 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1e8500e6-1957-4291-801f-bc19f8b53e58 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:36.199728 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1e8500e6-1957-4291-801f-bc19f8b53e58 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:36.200421 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1e8500e6-1957-4291-801f-bc19f8b53e58 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:36.201382 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1e8500e6-1957-4291-801f-bc19f8b53e58 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:36.202059 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1e8500e6-1957-4291-801f-bc19f8b53e58 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:36.202702 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1e8500e6-1957-4291-801f-bc19f8b53e58 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:36.391107 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-1e8500e6-1957-4291-801f-bc19f8b53e58 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:36.404389 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-1e8500e6-1957-4291-801f-bc19f8b53e58 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1372 microversion: 2.1 time: 0.222355 Sep 06 01:14:36.405021 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 244/475] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:36 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1372 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:36.425298 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-6cb5e0fb-6f46-48cc-93e8-1647d915d471 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:36.425967 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-6cb5e0fb-6f46-48cc-93e8-1647d915d471 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 70d2092a-968f-45aa-a07c-ee3b6f1a918e] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:36.497734 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-6cb5e0fb-6f46-48cc-93e8-1647d915d471 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:36.506584 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-6cb5e0fb-6f46-48cc-93e8-1647d915d471 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e" status: 200 len: 1218 microversion: 2.1 time: 0.100005 Sep 06 01:14:36.507503 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 245/476] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:36 2022] GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:36.512336 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-dda129ac-78d1-417a-ba1a-87cef47bf86f req-96842718-16c5-4ba0-bbcc-14017aeda332 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dff4f970-9216-4d56-81d9-f62b12ebccff", "name": "network-vif-plugged", "status": "completed", "tag": "e361c831-ec99-4391-ba22-77ddd7f8862c"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:14:36.527887 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-dda129ac-78d1-417a-ba1a-87cef47bf86f req-96842718-16c5-4ba0-bbcc-14017aeda332 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:36.528519 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-dda129ac-78d1-417a-ba1a-87cef47bf86f req-96842718-16c5-4ba0-bbcc-14017aeda332 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:36.529029 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-dda129ac-78d1-417a-ba1a-87cef47bf86f req-96842718-16c5-4ba0-bbcc-14017aeda332 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:36.545296 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.compute.server_external_events [req-dda129ac-78d1-417a-ba1a-87cef47bf86f req-96842718-16c5-4ba0-bbcc-14017aeda332 service nova] Creating event network-vif-plugged:e361c831-ec99-4391-ba22-77ddd7f8862c for instance dff4f970-9216-4d56-81d9-f62b12ebccff on hv-cinder-84773 Sep 06 01:14:36.552396 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [req-dda129ac-78d1-417a-ba1a-87cef47bf86f req-96842718-16c5-4ba0-bbcc-14017aeda332 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043215 Sep 06 01:14:36.553376 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 246/477] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:14:36.587296 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-18027f9e-c334-44f7-b4f9-586240dc31dd tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:36.588845 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-18027f9e-c334-44f7-b4f9-586240dc31dd tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] [instance: dff4f970-9216-4d56-81d9-f62b12ebccff] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:36.601161 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-18027f9e-c334-44f7-b4f9-586240dc31dd tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:36.601772 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-18027f9e-c334-44f7-b4f9-586240dc31dd tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:36.602322 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-18027f9e-c334-44f7-b4f9-586240dc31dd tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:36.603151 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-18027f9e-c334-44f7-b4f9-586240dc31dd tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:36.603698 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-18027f9e-c334-44f7-b4f9-586240dc31dd tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:36.604171 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-18027f9e-c334-44f7-b4f9-586240dc31dd tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:36.892602 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-18027f9e-c334-44f7-b4f9-586240dc31dd tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c48bdc1644230a97a6d9b8fe8f9f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd22b3b78f416ab10fd92ac92a5589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:36.915162 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-18027f9e-c334-44f7-b4f9-586240dc31dd tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] 10.222.0.23 "GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff" status: 200 len: 1314 microversion: 2.1 time: 0.333281 Sep 06 01:14:36.924679 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 247/478] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:36 2022] GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:37.026543 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-ad41f57b-4b3b-4bef-943f-6d296fc286a3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:37.027154 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-ad41f57b-4b3b-4bef-943f-6d296fc286a3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:37.036761 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ad41f57b-4b3b-4bef-943f-6d296fc286a3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:37.038070 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ad41f57b-4b3b-4bef-943f-6d296fc286a3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:37.039141 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ad41f57b-4b3b-4bef-943f-6d296fc286a3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:37.041753 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ad41f57b-4b3b-4bef-943f-6d296fc286a3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:37.044725 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ad41f57b-4b3b-4bef-943f-6d296fc286a3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:37.045610 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ad41f57b-4b3b-4bef-943f-6d296fc286a3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:37.101878 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4c9717cc-41f2-4661-b757-137c715013ed tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "POST /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.092523 Sep 06 01:14:37.115573 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 232/479] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Sep 6 01:14:36 2022] POST /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba/os-volume_attachments => generated 194 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:14:37.293798 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-ad41f57b-4b3b-4bef-943f-6d296fc286a3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:37.308757 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-ad41f57b-4b3b-4bef-943f-6d296fc286a3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:37.310585 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-ad41f57b-4b3b-4bef-943f-6d296fc286a3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:37.312067 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-ad41f57b-4b3b-4bef-943f-6d296fc286a3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1809 microversion: 2.20 time: 0.289491 Sep 06 01:14:37.313150 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 248/480] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:14:37 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1809 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:14:37.431448 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-53632c2a-5e57-493c-88cc-623726bda9f4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:37.432761 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-53632c2a-5e57-493c-88cc-623726bda9f4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:37.447303 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-53632c2a-5e57-493c-88cc-623726bda9f4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:37.448406 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-53632c2a-5e57-493c-88cc-623726bda9f4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:37.453102 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-53632c2a-5e57-493c-88cc-623726bda9f4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:37.455069 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-53632c2a-5e57-493c-88cc-623726bda9f4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:37.455560 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-53632c2a-5e57-493c-88cc-623726bda9f4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:37.456025 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-53632c2a-5e57-493c-88cc-623726bda9f4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:37.530458 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-679b9c01-55b2-457e-9d35-757f52316a64 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:37.531209 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-679b9c01-55b2-457e-9d35-757f52316a64 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 70d2092a-968f-45aa-a07c-ee3b6f1a918e] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:37.541520 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-679b9c01-55b2-457e-9d35-757f52316a64 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:37.542020 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-679b9c01-55b2-457e-9d35-757f52316a64 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:37.547278 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-679b9c01-55b2-457e-9d35-757f52316a64 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:37.548118 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-679b9c01-55b2-457e-9d35-757f52316a64 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:37.548786 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-679b9c01-55b2-457e-9d35-757f52316a64 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:37.549240 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-679b9c01-55b2-457e-9d35-757f52316a64 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:37.719505 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-679b9c01-55b2-457e-9d35-757f52316a64 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:37.739696 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-679b9c01-55b2-457e-9d35-757f52316a64 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e" status: 200 len: 1270 microversion: 2.1 time: 0.211053 Sep 06 01:14:37.759901 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 249/481] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:37 2022] GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e => generated 1270 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:37.947084 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-3417e74b-6f8c-48a2-82eb-12945515efc7 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:37.947984 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-3417e74b-6f8c-48a2-82eb-12945515efc7 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] [instance: dff4f970-9216-4d56-81d9-f62b12ebccff] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:37.956956 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3417e74b-6f8c-48a2-82eb-12945515efc7 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:37.958226 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3417e74b-6f8c-48a2-82eb-12945515efc7 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:37.962819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3417e74b-6f8c-48a2-82eb-12945515efc7 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:37.963953 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3417e74b-6f8c-48a2-82eb-12945515efc7 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:37.964577 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3417e74b-6f8c-48a2-82eb-12945515efc7 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:37.965621 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3417e74b-6f8c-48a2-82eb-12945515efc7 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:38.170192 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-53632c2a-5e57-493c-88cc-623726bda9f4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:38.188460 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-53632c2a-5e57-493c-88cc-623726bda9f4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1372 microversion: 2.1 time: 0.757349 Sep 06 01:14:38.190992 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 233/482] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:37 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1372 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:38.340010 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-76b390ef-0be9-440a-b094-e61a98564e7f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:38.340764 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-76b390ef-0be9-440a-b094-e61a98564e7f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:38.344916 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-3417e74b-6f8c-48a2-82eb-12945515efc7 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c48bdc1644230a97a6d9b8fe8f9f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd22b3b78f416ab10fd92ac92a5589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:38.352359 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-76b390ef-0be9-440a-b094-e61a98564e7f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:38.352844 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-76b390ef-0be9-440a-b094-e61a98564e7f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:38.357144 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-76b390ef-0be9-440a-b094-e61a98564e7f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:38.362223 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-76b390ef-0be9-440a-b094-e61a98564e7f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:38.364198 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-3417e74b-6f8c-48a2-82eb-12945515efc7 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] 10.222.0.23 "GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff" status: 200 len: 1314 microversion: 2.1 time: 0.418509 Sep 06 01:14:38.364988 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-76b390ef-0be9-440a-b094-e61a98564e7f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:38.365599 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-76b390ef-0be9-440a-b094-e61a98564e7f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:38.365720 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 250/483] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:37 2022] GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:14:38.634225 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-76b390ef-0be9-440a-b094-e61a98564e7f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:38.648292 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-76b390ef-0be9-440a-b094-e61a98564e7f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:38.651205 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-76b390ef-0be9-440a-b094-e61a98564e7f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:38.653578 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-76b390ef-0be9-440a-b094-e61a98564e7f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1809 microversion: 2.20 time: 0.318786 Sep 06 01:14:38.655590 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 234/484] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:14:38 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1809 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:14:38.776136 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-3369eff4-ce9e-4e17-a6f5-ffe5c5d6c9ea tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:38.777151 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-3369eff4-ce9e-4e17-a6f5-ffe5c5d6c9ea tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 70d2092a-968f-45aa-a07c-ee3b6f1a918e] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:38.790268 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3369eff4-ce9e-4e17-a6f5-ffe5c5d6c9ea tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:38.792016 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3369eff4-ce9e-4e17-a6f5-ffe5c5d6c9ea tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:38.792475 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3369eff4-ce9e-4e17-a6f5-ffe5c5d6c9ea tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:38.793498 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3369eff4-ce9e-4e17-a6f5-ffe5c5d6c9ea tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:38.795169 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3369eff4-ce9e-4e17-a6f5-ffe5c5d6c9ea tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:38.795617 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3369eff4-ce9e-4e17-a6f5-ffe5c5d6c9ea tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:38.922842 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-3369eff4-ce9e-4e17-a6f5-ffe5c5d6c9ea tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:38.932044 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-3369eff4-ce9e-4e17-a6f5-ffe5c5d6c9ea tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e" status: 200 len: 1270 microversion: 2.1 time: 0.168995 Sep 06 01:14:38.937369 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 251/485] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:38 2022] GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e => generated 1270 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:39.216342 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1b4513e7-cde9-4fe2-adf0-e69701247032 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:39.217165 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1b4513e7-cde9-4fe2-adf0-e69701247032 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:39.229588 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b4513e7-cde9-4fe2-adf0-e69701247032 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:39.231641 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b4513e7-cde9-4fe2-adf0-e69701247032 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:39.235453 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b4513e7-cde9-4fe2-adf0-e69701247032 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:39.236378 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b4513e7-cde9-4fe2-adf0-e69701247032 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:39.237212 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b4513e7-cde9-4fe2-adf0-e69701247032 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:39.239936 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b4513e7-cde9-4fe2-adf0-e69701247032 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:39.287279 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:39.388671 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-b0d5c8f5-e5ba-4eca-a5e5-cffbf9782270 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:39.389882 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-b0d5c8f5-e5ba-4eca-a5e5-cffbf9782270 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] [instance: dff4f970-9216-4d56-81d9-f62b12ebccff] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:39.406408 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b0d5c8f5-e5ba-4eca-a5e5-cffbf9782270 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:39.407171 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b0d5c8f5-e5ba-4eca-a5e5-cffbf9782270 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:39.407772 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b0d5c8f5-e5ba-4eca-a5e5-cffbf9782270 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:39.408630 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b0d5c8f5-e5ba-4eca-a5e5-cffbf9782270 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:39.409251 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b0d5c8f5-e5ba-4eca-a5e5-cffbf9782270 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:39.410520 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b0d5c8f5-e5ba-4eca-a5e5-cffbf9782270 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:39.701384 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-1b4513e7-cde9-4fe2-adf0-e69701247032 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:39.709586 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1b4513e7-cde9-4fe2-adf0-e69701247032 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1372 microversion: 2.1 time: 0.497034 Sep 06 01:14:39.714044 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 235/486] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:39 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1372 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:39.720486 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-93ac57bf-ea25-4402-be1e-574256683dd8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:39.722377 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-93ac57bf-ea25-4402-be1e-574256683dd8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:39.731548 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-b0d5c8f5-e5ba-4eca-a5e5-cffbf9782270 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c48bdc1644230a97a6d9b8fe8f9f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd22b3b78f416ab10fd92ac92a5589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:39.747504 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-b0d5c8f5-e5ba-4eca-a5e5-cffbf9782270 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] 10.222.0.23 "GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff" status: 200 len: 1314 microversion: 2.1 time: 0.362628 Sep 06 01:14:39.750311 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93ac57bf-ea25-4402-be1e-574256683dd8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:39.750729 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 252/487] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:39 2022] GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:14:39.751406 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93ac57bf-ea25-4402-be1e-574256683dd8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:39.752010 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93ac57bf-ea25-4402-be1e-574256683dd8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:39.752861 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93ac57bf-ea25-4402-be1e-574256683dd8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:39.753454 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93ac57bf-ea25-4402-be1e-574256683dd8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:39.754061 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93ac57bf-ea25-4402-be1e-574256683dd8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:39.909542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-93ac57bf-ea25-4402-be1e-574256683dd8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:39.921817 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-93ac57bf-ea25-4402-be1e-574256683dd8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:39.924420 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-93ac57bf-ea25-4402-be1e-574256683dd8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:39.926445 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-93ac57bf-ea25-4402-be1e-574256683dd8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1809 microversion: 2.20 time: 0.210595 Sep 06 01:14:39.927163 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 236/488] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:14:39 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1809 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:14:39.960598 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-39739e99-408f-4514-bb84-5e35c1ca643a tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:39.985692 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-39739e99-408f-4514-bb84-5e35c1ca643a tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 70d2092a-968f-45aa-a07c-ee3b6f1a918e] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:40.004075 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-39739e99-408f-4514-bb84-5e35c1ca643a tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:40.005935 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-39739e99-408f-4514-bb84-5e35c1ca643a tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:40.007014 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-39739e99-408f-4514-bb84-5e35c1ca643a tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:40.008096 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-39739e99-408f-4514-bb84-5e35c1ca643a tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:40.012102 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-39739e99-408f-4514-bb84-5e35c1ca643a tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:40.012883 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-39739e99-408f-4514-bb84-5e35c1ca643a tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:40.129732 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-39739e99-408f-4514-bb84-5e35c1ca643a tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:40.155993 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-39739e99-408f-4514-bb84-5e35c1ca643a tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e" status: 200 len: 1270 microversion: 2.1 time: 0.200356 Sep 06 01:14:40.157477 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 253/489] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:39 2022] GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e => generated 1270 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:40.745606 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ce2bc1fb-56b4-4d21-b439-529e45acbdb3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:40.746911 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ce2bc1fb-56b4-4d21-b439-529e45acbdb3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:40.762680 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce2bc1fb-56b4-4d21-b439-529e45acbdb3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:40.767831 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce2bc1fb-56b4-4d21-b439-529e45acbdb3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:40.768909 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce2bc1fb-56b4-4d21-b439-529e45acbdb3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:40.782833 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-d94f53dd-aa9e-488d-9549-6c1b70e878ab tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:40.783540 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce2bc1fb-56b4-4d21-b439-529e45acbdb3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:40.788706 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-d94f53dd-aa9e-488d-9549-6c1b70e878ab tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] [instance: dff4f970-9216-4d56-81d9-f62b12ebccff] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:40.793464 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce2bc1fb-56b4-4d21-b439-529e45acbdb3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:40.796450 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce2bc1fb-56b4-4d21-b439-529e45acbdb3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:40.807563 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d94f53dd-aa9e-488d-9549-6c1b70e878ab tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:40.810267 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d94f53dd-aa9e-488d-9549-6c1b70e878ab tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:40.810739 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d94f53dd-aa9e-488d-9549-6c1b70e878ab tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:40.811471 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d94f53dd-aa9e-488d-9549-6c1b70e878ab tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:40.811969 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d94f53dd-aa9e-488d-9549-6c1b70e878ab tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:40.812400 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d94f53dd-aa9e-488d-9549-6c1b70e878ab tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:41.276775 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-d94f53dd-aa9e-488d-9549-6c1b70e878ab tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c48bdc1644230a97a6d9b8fe8f9f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd22b3b78f416ab10fd92ac92a5589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:41.287929 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-ce2bc1fb-56b4-4d21-b439-529e45acbdb3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:41.290189 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-d94f53dd-aa9e-488d-9549-6c1b70e878ab tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] 10.222.0.23 "GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff" status: 200 len: 1314 microversion: 2.1 time: 0.512102 Sep 06 01:14:41.303780 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 254/490] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:40 2022] GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff => generated 1314 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:41.303780 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-7d3a7ac0-2505-4459-8498-3747d6680ae9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:41.303780 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-7d3a7ac0-2505-4459-8498-3747d6680ae9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:41.304440 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7d3a7ac0-2505-4459-8498-3747d6680ae9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:41.305124 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7d3a7ac0-2505-4459-8498-3747d6680ae9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:41.305705 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7d3a7ac0-2505-4459-8498-3747d6680ae9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:41.306870 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7d3a7ac0-2505-4459-8498-3747d6680ae9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:41.307500 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7d3a7ac0-2505-4459-8498-3747d6680ae9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:41.308122 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7d3a7ac0-2505-4459-8498-3747d6680ae9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:41.319081 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ce2bc1fb-56b4-4d21-b439-529e45acbdb3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1372 microversion: 2.1 time: 0.579789 Sep 06 01:14:41.327925 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 237/491] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:40 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1372 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:41.348910 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-50d1b049-2ee6-412e-a2f3-a12fbdd1dbea tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:41.352872 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-50d1b049-2ee6-412e-a2f3-a12fbdd1dbea tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 70d2092a-968f-45aa-a07c-ee3b6f1a918e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:41.362808 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50d1b049-2ee6-412e-a2f3-a12fbdd1dbea tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:41.364544 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50d1b049-2ee6-412e-a2f3-a12fbdd1dbea tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:41.365065 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50d1b049-2ee6-412e-a2f3-a12fbdd1dbea tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:41.365851 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50d1b049-2ee6-412e-a2f3-a12fbdd1dbea tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:41.366429 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50d1b049-2ee6-412e-a2f3-a12fbdd1dbea tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:41.367636 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50d1b049-2ee6-412e-a2f3-a12fbdd1dbea tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:41.598946 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-50d1b049-2ee6-412e-a2f3-a12fbdd1dbea tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:41.614775 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-50d1b049-2ee6-412e-a2f3-a12fbdd1dbea tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e" status: 200 len: 1270 microversion: 2.1 time: 0.285562 Sep 06 01:14:41.615606 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 238/492] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:41 2022] GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e => generated 1270 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:41.655403 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-7d3a7ac0-2505-4459-8498-3747d6680ae9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:41.670884 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-7d3a7ac0-2505-4459-8498-3747d6680ae9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:41.676204 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-7d3a7ac0-2505-4459-8498-3747d6680ae9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:41.680204 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-7d3a7ac0-2505-4459-8498-3747d6680ae9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1809 microversion: 2.20 time: 0.387890 Sep 06 01:14:41.680889 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 255/493] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:14:41 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1809 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:14:42.228338 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-8b207a8a-5741-48bf-89db-403cf5905862 req-a09a9dc0-4f14-4c34-a605-3044c9abffeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce3f054d-45b3-41c2-9f87-c32efa7bc088", "name": "network-vif-plugged", "status": "completed", "tag": "5bfb66f4-238b-4ee5-8ff6-581b693fd4eb"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:14:42.239731 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8b207a8a-5741-48bf-89db-403cf5905862 req-a09a9dc0-4f14-4c34-a605-3044c9abffeb service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:42.240597 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8b207a8a-5741-48bf-89db-403cf5905862 req-a09a9dc0-4f14-4c34-a605-3044c9abffeb service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:42.241248 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8b207a8a-5741-48bf-89db-403cf5905862 req-a09a9dc0-4f14-4c34-a605-3044c9abffeb service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:42.262342 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-8b207a8a-5741-48bf-89db-403cf5905862 req-a09a9dc0-4f14-4c34-a605-3044c9abffeb service nova] Creating event network-vif-plugged:5bfb66f4-238b-4ee5-8ff6-581b693fd4eb for instance ce3f054d-45b3-41c2-9f87-c32efa7bc088 on hv-cinder-84773 Sep 06 01:14:42.268531 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-8b207a8a-5741-48bf-89db-403cf5905862 req-a09a9dc0-4f14-4c34-a605-3044c9abffeb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044327 Sep 06 01:14:42.269974 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 239/494] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:14:42.319838 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-8e065b63-8a3e-4a76-9e71-768b611164db tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:42.320440 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-8e065b63-8a3e-4a76-9e71-768b611164db tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] [instance: dff4f970-9216-4d56-81d9-f62b12ebccff] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:42.328252 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8e065b63-8a3e-4a76-9e71-768b611164db tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:42.328982 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8e065b63-8a3e-4a76-9e71-768b611164db tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:42.329641 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8e065b63-8a3e-4a76-9e71-768b611164db tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:42.330777 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8e065b63-8a3e-4a76-9e71-768b611164db tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:42.331408 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8e065b63-8a3e-4a76-9e71-768b611164db tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:42.342012 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8e065b63-8a3e-4a76-9e71-768b611164db tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:42.360191 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8307f7bd-85b0-4bed-904b-1fb8445a4656 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:42.360191 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8307f7bd-85b0-4bed-904b-1fb8445a4656 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:42.372508 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8307f7bd-85b0-4bed-904b-1fb8445a4656 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:42.388524 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8307f7bd-85b0-4bed-904b-1fb8445a4656 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:42.389293 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8307f7bd-85b0-4bed-904b-1fb8445a4656 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:42.390360 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8307f7bd-85b0-4bed-904b-1fb8445a4656 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:42.391010 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8307f7bd-85b0-4bed-904b-1fb8445a4656 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:42.391636 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8307f7bd-85b0-4bed-904b-1fb8445a4656 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:42.676933 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-8e065b63-8a3e-4a76-9e71-768b611164db tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c48bdc1644230a97a6d9b8fe8f9f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd22b3b78f416ab10fd92ac92a5589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:42.682261 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell1:SELECT=100 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:42.693939 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-8e065b63-8a3e-4a76-9e71-768b611164db tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] 10.222.0.23 "GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff" status: 200 len: 1314 microversion: 2.1 time: 0.379224 Sep 06 01:14:42.698052 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 256/495] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:42 2022] GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:42.714525 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-827cfb0e-c26e-4226-ba98-d06b9b8e8c7b tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:42.717064 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-827cfb0e-c26e-4226-ba98-d06b9b8e8c7b tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 70d2092a-968f-45aa-a07c-ee3b6f1a918e] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:42.741126 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-827cfb0e-c26e-4226-ba98-d06b9b8e8c7b tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:42.741659 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-827cfb0e-c26e-4226-ba98-d06b9b8e8c7b tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:42.744460 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-827cfb0e-c26e-4226-ba98-d06b9b8e8c7b tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:42.744460 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-827cfb0e-c26e-4226-ba98-d06b9b8e8c7b tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:42.744460 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-827cfb0e-c26e-4226-ba98-d06b9b8e8c7b tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:42.744460 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-827cfb0e-c26e-4226-ba98-d06b9b8e8c7b tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:42.795012 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-8307f7bd-85b0-4bed-904b-1fb8445a4656 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:42.808288 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8307f7bd-85b0-4bed-904b-1fb8445a4656 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1372 microversion: 2.1 time: 0.459262 Sep 06 01:14:42.808867 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 240/496] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:42 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1372 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:42.842044 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d7d4dfc0-9a53-47c2-a16c-f4d32b22815a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:42.842568 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d7d4dfc0-9a53-47c2-a16c-f4d32b22815a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:42.850338 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-827cfb0e-c26e-4226-ba98-d06b9b8e8c7b tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:42.859359 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d7d4dfc0-9a53-47c2-a16c-f4d32b22815a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:42.862286 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d7d4dfc0-9a53-47c2-a16c-f4d32b22815a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:42.864162 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d7d4dfc0-9a53-47c2-a16c-f4d32b22815a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:42.864835 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-827cfb0e-c26e-4226-ba98-d06b9b8e8c7b tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e" status: 200 len: 1270 microversion: 2.1 time: 0.165353 Sep 06 01:14:42.865567 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d7d4dfc0-9a53-47c2-a16c-f4d32b22815a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:42.865981 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 257/497] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:42 2022] GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e => generated 1270 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:42.866619 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d7d4dfc0-9a53-47c2-a16c-f4d32b22815a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:42.868262 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d7d4dfc0-9a53-47c2-a16c-f4d32b22815a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:43.255372 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-d7d4dfc0-9a53-47c2-a16c-f4d32b22815a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:43.267570 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-d7d4dfc0-9a53-47c2-a16c-f4d32b22815a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:43.270023 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-d7d4dfc0-9a53-47c2-a16c-f4d32b22815a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:43.271411 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d7d4dfc0-9a53-47c2-a16c-f4d32b22815a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1809 microversion: 2.20 time: 0.436779 Sep 06 01:14:43.272781 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 241/498] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:14:42 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1809 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:14:43.720541 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-4ec917bc-8b66-4da6-b780-c84f78ac4eb8 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:43.722282 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-4ec917bc-8b66-4da6-b780-c84f78ac4eb8 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] [instance: dff4f970-9216-4d56-81d9-f62b12ebccff] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:43.745032 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4ec917bc-8b66-4da6-b780-c84f78ac4eb8 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:43.746650 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4ec917bc-8b66-4da6-b780-c84f78ac4eb8 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:43.749525 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4ec917bc-8b66-4da6-b780-c84f78ac4eb8 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:43.750525 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4ec917bc-8b66-4da6-b780-c84f78ac4eb8 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:43.751149 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4ec917bc-8b66-4da6-b780-c84f78ac4eb8 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:43.754646 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4ec917bc-8b66-4da6-b780-c84f78ac4eb8 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:43.830534 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f830796a-afa2-48f3-a4a7-4b3de4f92a63 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:43.831451 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f830796a-afa2-48f3-a4a7-4b3de4f92a63 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:43.842512 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f830796a-afa2-48f3-a4a7-4b3de4f92a63 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:43.843528 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f830796a-afa2-48f3-a4a7-4b3de4f92a63 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:43.844966 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f830796a-afa2-48f3-a4a7-4b3de4f92a63 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:43.845870 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f830796a-afa2-48f3-a4a7-4b3de4f92a63 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:43.846606 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f830796a-afa2-48f3-a4a7-4b3de4f92a63 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:43.847452 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f830796a-afa2-48f3-a4a7-4b3de4f92a63 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:44.067363 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-4ec917bc-8b66-4da6-b780-c84f78ac4eb8 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c48bdc1644230a97a6d9b8fe8f9f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd22b3b78f416ab10fd92ac92a5589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:44.081090 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-4ec917bc-8b66-4da6-b780-c84f78ac4eb8 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] 10.222.0.23 "GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff" status: 200 len: 1463 microversion: 2.1 time: 0.366761 Sep 06 01:14:44.084722 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 258/499] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:43 2022] GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff => generated 1463 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:44.094249 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-e901796e-35e4-4c2c-8c85-a197af34be9d tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:44.096102 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-e901796e-35e4-4c2c-8c85-a197af34be9d tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 70d2092a-968f-45aa-a07c-ee3b6f1a918e] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:44.107307 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e901796e-35e4-4c2c-8c85-a197af34be9d tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:44.108491 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e901796e-35e4-4c2c-8c85-a197af34be9d tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:44.108491 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e901796e-35e4-4c2c-8c85-a197af34be9d tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:44.116207 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e901796e-35e4-4c2c-8c85-a197af34be9d tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:44.118375 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e901796e-35e4-4c2c-8c85-a197af34be9d tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:44.119967 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e901796e-35e4-4c2c-8c85-a197af34be9d tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:44.205688 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-f830796a-afa2-48f3-a4a7-4b3de4f92a63 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:44.220642 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f830796a-afa2-48f3-a4a7-4b3de4f92a63 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1372 microversion: 2.1 time: 0.393933 Sep 06 01:14:44.232661 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 242/500] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:43 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1372 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:44.251448 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-24ffa257-4467-42dc-a6f3-60942b11523b tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:44.252771 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-24ffa257-4467-42dc-a6f3-60942b11523b tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] [instance: dff4f970-9216-4d56-81d9-f62b12ebccff] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:44.285685 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-24ffa257-4467-42dc-a6f3-60942b11523b tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:44.286979 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-24ffa257-4467-42dc-a6f3-60942b11523b tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:44.287618 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-24ffa257-4467-42dc-a6f3-60942b11523b tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:44.288532 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-24ffa257-4467-42dc-a6f3-60942b11523b tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:44.289151 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-24ffa257-4467-42dc-a6f3-60942b11523b tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:44.289788 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-24ffa257-4467-42dc-a6f3-60942b11523b tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:44.331407 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-e901796e-35e4-4c2c-8c85-a197af34be9d tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:44.341589 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-e901796e-35e4-4c2c-8c85-a197af34be9d tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e" status: 200 len: 1270 microversion: 2.1 time: 0.255666 Sep 06 01:14:44.342029 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-24ffa257-4467-42dc-a6f3-60942b11523b tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] [instance: dff4f970-9216-4d56-81d9-f62b12ebccff] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 01:14:44.342153 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 259/501] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:44 2022] GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e => generated 1270 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:44.366877 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-625b3a80-29d7-4b10-82ea-3dab693d98b6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:44.367781 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-625b3a80-29d7-4b10-82ea-3dab693d98b6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:44.374123 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-625b3a80-29d7-4b10-82ea-3dab693d98b6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:44.374921 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-625b3a80-29d7-4b10-82ea-3dab693d98b6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:44.375612 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-625b3a80-29d7-4b10-82ea-3dab693d98b6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:44.376608 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-625b3a80-29d7-4b10-82ea-3dab693d98b6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:44.377278 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-625b3a80-29d7-4b10-82ea-3dab693d98b6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:44.377916 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-625b3a80-29d7-4b10-82ea-3dab693d98b6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:44.594019 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-24ffa257-4467-42dc-a6f3-60942b11523b tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] 10.222.0.23 "DELETE /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff" status: 204 len: 0 microversion: 2.1 time: 0.359379 Sep 06 01:14:44.596120 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 243/502] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 6 01:14:44 2022] DELETE /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 01:14:44.610951 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-98a8e69a-8910-4a5d-bb0c-16b679694ca5 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:44.611678 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-98a8e69a-8910-4a5d-bb0c-16b679694ca5 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] [instance: dff4f970-9216-4d56-81d9-f62b12ebccff] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:44.624833 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98a8e69a-8910-4a5d-bb0c-16b679694ca5 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:44.627183 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98a8e69a-8910-4a5d-bb0c-16b679694ca5 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:44.627641 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98a8e69a-8910-4a5d-bb0c-16b679694ca5 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:44.628464 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98a8e69a-8910-4a5d-bb0c-16b679694ca5 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:44.629591 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98a8e69a-8910-4a5d-bb0c-16b679694ca5 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:44.630014 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98a8e69a-8910-4a5d-bb0c-16b679694ca5 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:44.833182 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-625b3a80-29d7-4b10-82ea-3dab693d98b6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:44.851556 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-625b3a80-29d7-4b10-82ea-3dab693d98b6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:44.853860 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-625b3a80-29d7-4b10-82ea-3dab693d98b6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:44.858355 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-625b3a80-29d7-4b10-82ea-3dab693d98b6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1809 microversion: 2.20 time: 0.500536 Sep 06 01:14:44.875311 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 260/503] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:14:44 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1809 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:14:44.953771 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-98a8e69a-8910-4a5d-bb0c-16b679694ca5 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c48bdc1644230a97a6d9b8fe8f9f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd22b3b78f416ab10fd92ac92a5589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:44.963072 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-98a8e69a-8910-4a5d-bb0c-16b679694ca5 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] 10.222.0.23 "GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff" status: 200 len: 1469 microversion: 2.1 time: 0.362480 Sep 06 01:14:44.964085 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 244/504] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:44 2022] GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff => generated 1469 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:14:45.253955 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-fab0cf1b-139a-44b2-aea1-9fadba8a042f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:45.254596 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-fab0cf1b-139a-44b2-aea1-9fadba8a042f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:45.260918 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fab0cf1b-139a-44b2-aea1-9fadba8a042f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:45.261628 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fab0cf1b-139a-44b2-aea1-9fadba8a042f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:45.262370 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fab0cf1b-139a-44b2-aea1-9fadba8a042f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:45.263521 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fab0cf1b-139a-44b2-aea1-9fadba8a042f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:45.264358 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fab0cf1b-139a-44b2-aea1-9fadba8a042f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:45.267238 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fab0cf1b-139a-44b2-aea1-9fadba8a042f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:45.369148 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5b8d779e-cd80-444c-acae-9240052a24d7 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:45.369738 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5b8d779e-cd80-444c-acae-9240052a24d7 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 70d2092a-968f-45aa-a07c-ee3b6f1a918e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:45.376298 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b8d779e-cd80-444c-acae-9240052a24d7 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:45.376783 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b8d779e-cd80-444c-acae-9240052a24d7 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:45.377224 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b8d779e-cd80-444c-acae-9240052a24d7 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:45.379738 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b8d779e-cd80-444c-acae-9240052a24d7 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:45.382712 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b8d779e-cd80-444c-acae-9240052a24d7 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:45.383167 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b8d779e-cd80-444c-acae-9240052a24d7 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:45.493000 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-fab0cf1b-139a-44b2-aea1-9fadba8a042f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:45.505981 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-fab0cf1b-139a-44b2-aea1-9fadba8a042f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1372 microversion: 2.1 time: 0.261365 Sep 06 01:14:45.508337 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 261/505] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:45 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1372 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:45.527793 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-5b8d779e-cd80-444c-acae-9240052a24d7 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:45.542090 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5b8d779e-cd80-444c-acae-9240052a24d7 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e" status: 200 len: 1270 microversion: 2.1 time: 0.176190 Sep 06 01:14:45.542090 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 245/506] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:45 2022] GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e => generated 1270 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:45.890468 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-533e905b-82e7-44d3-b371-f2668737426b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:45.892327 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-533e905b-82e7-44d3-b371-f2668737426b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:45.907608 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-533e905b-82e7-44d3-b371-f2668737426b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:45.908589 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-533e905b-82e7-44d3-b371-f2668737426b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:45.909350 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-533e905b-82e7-44d3-b371-f2668737426b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:45.910768 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-533e905b-82e7-44d3-b371-f2668737426b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:45.911592 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-533e905b-82e7-44d3-b371-f2668737426b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:45.912477 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-533e905b-82e7-44d3-b371-f2668737426b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:45.993462 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-182cad52-f4a6-4e50-8acf-a69ce6fc7051 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:45.994633 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-182cad52-f4a6-4e50-8acf-a69ce6fc7051 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] [instance: dff4f970-9216-4d56-81d9-f62b12ebccff] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:46.010587 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-182cad52-f4a6-4e50-8acf-a69ce6fc7051 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:46.011182 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-182cad52-f4a6-4e50-8acf-a69ce6fc7051 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:46.012220 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-182cad52-f4a6-4e50-8acf-a69ce6fc7051 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:46.013213 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-182cad52-f4a6-4e50-8acf-a69ce6fc7051 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:46.013776 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-182cad52-f4a6-4e50-8acf-a69ce6fc7051 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:46.014301 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-182cad52-f4a6-4e50-8acf-a69ce6fc7051 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:46.075846 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell0:SELECT=2 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:46.505415 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell0:SELECT=8 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:46.519781 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-182cad52-f4a6-4e50-8acf-a69ce6fc7051 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c48bdc1644230a97a6d9b8fe8f9f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd22b3b78f416ab10fd92ac92a5589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:46.531998 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-182cad52-f4a6-4e50-8acf-a69ce6fc7051 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] 10.222.0.23 "GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff" status: 200 len: 1469 microversion: 2.1 time: 0.544984 Sep 06 01:14:46.532607 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 246/507] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:45 2022] GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff => generated 1469 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:14:46.552407 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0cbee398-d133-4fd7-8bfd-074e3af6e850 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:46.552549 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-533e905b-82e7-44d3-b371-f2668737426b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:46.553643 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0cbee398-d133-4fd7-8bfd-074e3af6e850 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:46.560693 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0cbee398-d133-4fd7-8bfd-074e3af6e850 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:46.561187 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0cbee398-d133-4fd7-8bfd-074e3af6e850 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:46.561621 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0cbee398-d133-4fd7-8bfd-074e3af6e850 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:46.562287 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-533e905b-82e7-44d3-b371-f2668737426b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:46.562413 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0cbee398-d133-4fd7-8bfd-074e3af6e850 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:46.562757 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0cbee398-d133-4fd7-8bfd-074e3af6e850 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:46.563177 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0cbee398-d133-4fd7-8bfd-074e3af6e850 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:46.571048 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-533e905b-82e7-44d3-b371-f2668737426b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:46.572454 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-533e905b-82e7-44d3-b371-f2668737426b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1809 microversion: 2.20 time: 0.686281 Sep 06 01:14:46.575683 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 262/508] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:14:45 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1809 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:14:46.580863 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-e3ff1cef-ac6e-43b2-8289-d4f5cb790122 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:46.581714 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-e3ff1cef-ac6e-43b2-8289-d4f5cb790122 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 70d2092a-968f-45aa-a07c-ee3b6f1a918e] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:46.588834 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e3ff1cef-ac6e-43b2-8289-d4f5cb790122 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:46.589584 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e3ff1cef-ac6e-43b2-8289-d4f5cb790122 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:46.590210 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e3ff1cef-ac6e-43b2-8289-d4f5cb790122 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:46.591098 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e3ff1cef-ac6e-43b2-8289-d4f5cb790122 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:46.591716 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e3ff1cef-ac6e-43b2-8289-d4f5cb790122 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:46.592320 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e3ff1cef-ac6e-43b2-8289-d4f5cb790122 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:46.712799 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-e3ff1cef-ac6e-43b2-8289-d4f5cb790122 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:46.726506 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-e3ff1cef-ac6e-43b2-8289-d4f5cb790122 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e" status: 200 len: 1270 microversion: 2.1 time: 0.149382 Sep 06 01:14:46.745319 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 263/509] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:46 2022] GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e => generated 1270 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:46.954707 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-0cbee398-d133-4fd7-8bfd-074e3af6e850 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:46.968192 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0cbee398-d133-4fd7-8bfd-074e3af6e850 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1372 microversion: 2.1 time: 0.426766 Sep 06 01:14:46.970745 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 247/510] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:46 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1372 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:14:47.569078 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-03eb8c44-0e7d-4f9c-bed0-7851a8a4c721 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:47.570517 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-03eb8c44-0e7d-4f9c-bed0-7851a8a4c721 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] [instance: dff4f970-9216-4d56-81d9-f62b12ebccff] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:47.582005 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-03eb8c44-0e7d-4f9c-bed0-7851a8a4c721 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:47.583308 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-03eb8c44-0e7d-4f9c-bed0-7851a8a4c721 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:47.583963 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-03eb8c44-0e7d-4f9c-bed0-7851a8a4c721 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:47.584910 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-03eb8c44-0e7d-4f9c-bed0-7851a8a4c721 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:47.585539 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-03eb8c44-0e7d-4f9c-bed0-7851a8a4c721 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:47.586198 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-03eb8c44-0e7d-4f9c-bed0-7851a8a4c721 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:47.610411 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3aad6cfa-795f-4557-a000-1d4a371efaaf tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:47.611622 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3aad6cfa-795f-4557-a000-1d4a371efaaf tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:47.633939 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3aad6cfa-795f-4557-a000-1d4a371efaaf tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:47.636912 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3aad6cfa-795f-4557-a000-1d4a371efaaf tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:47.637553 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3aad6cfa-795f-4557-a000-1d4a371efaaf tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:47.640239 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3aad6cfa-795f-4557-a000-1d4a371efaaf tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:47.643721 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3aad6cfa-795f-4557-a000-1d4a371efaaf tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:47.644451 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3aad6cfa-795f-4557-a000-1d4a371efaaf tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:47.878367 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-03eb8c44-0e7d-4f9c-bed0-7851a8a4c721 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c48bdc1644230a97a6d9b8fe8f9f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd22b3b78f416ab10fd92ac92a5589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:47.896569 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-03eb8c44-0e7d-4f9c-bed0-7851a8a4c721 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] 10.222.0.23 "GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff" status: 200 len: 1469 microversion: 2.1 time: 0.335985 Sep 06 01:14:47.898243 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 264/511] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:47 2022] GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff => generated 1469 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:47.909196 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-10caba13-f2eb-452f-b84c-90eddadc7112 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:47.910377 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-10caba13-f2eb-452f-b84c-90eddadc7112 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 70d2092a-968f-45aa-a07c-ee3b6f1a918e] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:47.922398 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-10caba13-f2eb-452f-b84c-90eddadc7112 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:47.922889 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-10caba13-f2eb-452f-b84c-90eddadc7112 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:47.923324 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-10caba13-f2eb-452f-b84c-90eddadc7112 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:47.939723 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-10caba13-f2eb-452f-b84c-90eddadc7112 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:47.940967 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-10caba13-f2eb-452f-b84c-90eddadc7112 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:47.940967 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-10caba13-f2eb-452f-b84c-90eddadc7112 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:48.154625 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-10caba13-f2eb-452f-b84c-90eddadc7112 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:48.169803 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-10caba13-f2eb-452f-b84c-90eddadc7112 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e" status: 200 len: 1270 microversion: 2.1 time: 0.271219 Sep 06 01:14:48.170608 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 265/512] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:47 2022] GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e => generated 1270 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:48.184924 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-5bc19a23-05e4-4b12-aba2-4709509afe79 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:48.184924 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-5bc19a23-05e4-4b12-aba2-4709509afe79 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:48.195404 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5bc19a23-05e4-4b12-aba2-4709509afe79 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:48.195951 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5bc19a23-05e4-4b12-aba2-4709509afe79 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:48.196398 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5bc19a23-05e4-4b12-aba2-4709509afe79 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:48.197115 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5bc19a23-05e4-4b12-aba2-4709509afe79 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:48.207994 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5bc19a23-05e4-4b12-aba2-4709509afe79 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:48.208608 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5bc19a23-05e4-4b12-aba2-4709509afe79 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:48.220558 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-3aad6cfa-795f-4557-a000-1d4a371efaaf tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:48.233679 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-3aad6cfa-795f-4557-a000-1d4a371efaaf tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:48.235154 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-3aad6cfa-795f-4557-a000-1d4a371efaaf tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:48.236378 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3aad6cfa-795f-4557-a000-1d4a371efaaf tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1809 microversion: 2.20 time: 0.634939 Sep 06 01:14:48.236941 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 248/513] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:14:47 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1809 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:14:48.399207 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-5bc19a23-05e4-4b12-aba2-4709509afe79 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:48.407646 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-5bc19a23-05e4-4b12-aba2-4709509afe79 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1372 microversion: 2.1 time: 0.236200 Sep 06 01:14:48.423714 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 266/514] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:48 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1372 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:48.925010 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e460c324-1325-4891-aa99-8c23b2cf54a1 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:48.925832 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e460c324-1325-4891-aa99-8c23b2cf54a1 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] [instance: dff4f970-9216-4d56-81d9-f62b12ebccff] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:48.938238 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e460c324-1325-4891-aa99-8c23b2cf54a1 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:48.938736 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e460c324-1325-4891-aa99-8c23b2cf54a1 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:48.939234 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e460c324-1325-4891-aa99-8c23b2cf54a1 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:48.939936 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e460c324-1325-4891-aa99-8c23b2cf54a1 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:48.940416 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e460c324-1325-4891-aa99-8c23b2cf54a1 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:48.940835 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e460c324-1325-4891-aa99-8c23b2cf54a1 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:49.170096 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-e460c324-1325-4891-aa99-8c23b2cf54a1 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c48bdc1644230a97a6d9b8fe8f9f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd22b3b78f416ab10fd92ac92a5589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:49.181923 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e460c324-1325-4891-aa99-8c23b2cf54a1 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] 10.222.0.23 "GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff" status: 200 len: 1469 microversion: 2.1 time: 0.260689 Sep 06 01:14:49.183136 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 249/515] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:48 2022] GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff => generated 1469 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:49.194518 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-f083fc20-336b-49ad-9900-6c7d7885409f tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:49.196059 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-f083fc20-336b-49ad-9900-6c7d7885409f tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 70d2092a-968f-45aa-a07c-ee3b6f1a918e] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:49.203635 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f083fc20-336b-49ad-9900-6c7d7885409f tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:49.204169 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f083fc20-336b-49ad-9900-6c7d7885409f tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:49.204614 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f083fc20-336b-49ad-9900-6c7d7885409f tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:49.205328 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f083fc20-336b-49ad-9900-6c7d7885409f tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:49.205801 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f083fc20-336b-49ad-9900-6c7d7885409f tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:49.206224 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f083fc20-336b-49ad-9900-6c7d7885409f tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:49.272108 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-86c0600b-31da-453c-be4f-661e2976e629 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:49.275698 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-86c0600b-31da-453c-be4f-661e2976e629 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:49.292031 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86c0600b-31da-453c-be4f-661e2976e629 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:49.292528 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86c0600b-31da-453c-be4f-661e2976e629 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:49.294417 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86c0600b-31da-453c-be4f-661e2976e629 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:49.295970 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86c0600b-31da-453c-be4f-661e2976e629 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:49.296643 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86c0600b-31da-453c-be4f-661e2976e629 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:49.298159 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86c0600b-31da-453c-be4f-661e2976e629 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:49.325394 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-f083fc20-336b-49ad-9900-6c7d7885409f tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:49.337087 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-f083fc20-336b-49ad-9900-6c7d7885409f tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e" status: 200 len: 1270 microversion: 2.1 time: 0.146996 Sep 06 01:14:49.337657 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 267/516] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:49 2022] GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e => generated 1270 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:49.434874 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-98949757-ac90-459b-9782-caf2c957d10e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:49.435872 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-98949757-ac90-459b-9782-caf2c957d10e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:49.445435 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-98949757-ac90-459b-9782-caf2c957d10e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:49.446242 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-98949757-ac90-459b-9782-caf2c957d10e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:49.446891 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-98949757-ac90-459b-9782-caf2c957d10e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:49.448054 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-98949757-ac90-459b-9782-caf2c957d10e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:49.448707 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-98949757-ac90-459b-9782-caf2c957d10e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:49.449329 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-98949757-ac90-459b-9782-caf2c957d10e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:49.486053 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-86c0600b-31da-453c-be4f-661e2976e629 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:49.491208 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:49.510046 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-86c0600b-31da-453c-be4f-661e2976e629 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:49.514127 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-86c0600b-31da-453c-be4f-661e2976e629 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:49.515568 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-86c0600b-31da-453c-be4f-661e2976e629 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1809 microversion: 2.20 time: 0.252917 Sep 06 01:14:49.536566 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 250/517] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:14:49 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1809 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:14:49.685585 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-98949757-ac90-459b-9782-caf2c957d10e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:49.696945 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-98949757-ac90-459b-9782-caf2c957d10e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1372 microversion: 2.1 time: 0.269708 Sep 06 01:14:49.697532 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 268/518] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:49 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1372 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:14:50.087414 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-818d11d8-4146-4fc0-a3ae-972a745e94e6 req-3923ae11-e9b4-4607-8500-7ec8ab39b668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dff4f970-9216-4d56-81d9-f62b12ebccff", "name": "network-vif-unplugged", "status": "completed", "tag": "e361c831-ec99-4391-ba22-77ddd7f8862c"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:14:50.101826 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-818d11d8-4146-4fc0-a3ae-972a745e94e6 req-3923ae11-e9b4-4607-8500-7ec8ab39b668 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:50.103251 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-818d11d8-4146-4fc0-a3ae-972a745e94e6 req-3923ae11-e9b4-4607-8500-7ec8ab39b668 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:50.104268 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-818d11d8-4146-4fc0-a3ae-972a745e94e6 req-3923ae11-e9b4-4607-8500-7ec8ab39b668 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:50.119713 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-818d11d8-4146-4fc0-a3ae-972a745e94e6 req-3923ae11-e9b4-4607-8500-7ec8ab39b668 service nova] Creating event network-vif-unplugged:e361c831-ec99-4391-ba22-77ddd7f8862c for instance dff4f970-9216-4d56-81d9-f62b12ebccff on hv-cinder-84773 Sep 06 01:14:50.130511 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-818d11d8-4146-4fc0-a3ae-972a745e94e6 req-3923ae11-e9b4-4607-8500-7ec8ab39b668 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046739 Sep 06 01:14:50.131710 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 251/519] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:14:50.209004 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-65ce3e98-5bbe-46de-b422-70f766442cfd tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:50.210320 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-65ce3e98-5bbe-46de-b422-70f766442cfd tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] [instance: dff4f970-9216-4d56-81d9-f62b12ebccff] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:50.216720 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:50.218410 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-65ce3e98-5bbe-46de-b422-70f766442cfd tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:50.219018 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-65ce3e98-5bbe-46de-b422-70f766442cfd tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:50.219652 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-65ce3e98-5bbe-46de-b422-70f766442cfd tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:50.220519 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-65ce3e98-5bbe-46de-b422-70f766442cfd tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:50.220880 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-65ce3e98-5bbe-46de-b422-70f766442cfd tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:50.221343 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-65ce3e98-5bbe-46de-b422-70f766442cfd tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:50.360752 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cd210491-0341-4c30-ac74-43ccda887385 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:50.361455 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cd210491-0341-4c30-ac74-43ccda887385 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 70d2092a-968f-45aa-a07c-ee3b6f1a918e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:50.375284 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cd210491-0341-4c30-ac74-43ccda887385 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:50.376705 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cd210491-0341-4c30-ac74-43ccda887385 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:50.376705 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cd210491-0341-4c30-ac74-43ccda887385 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:50.376705 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cd210491-0341-4c30-ac74-43ccda887385 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:50.377042 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cd210491-0341-4c30-ac74-43ccda887385 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:50.377445 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cd210491-0341-4c30-ac74-43ccda887385 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:50.399127 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-65ce3e98-5bbe-46de-b422-70f766442cfd tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c48bdc1644230a97a6d9b8fe8f9f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd22b3b78f416ab10fd92ac92a5589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:50.411774 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-65ce3e98-5bbe-46de-b422-70f766442cfd tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] 10.222.0.23 "GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff" status: 200 len: 1469 microversion: 2.1 time: 0.207495 Sep 06 01:14:50.413521 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 269/520] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:50 2022] GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff => generated 1469 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:50.463230 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-cd210491-0341-4c30-ac74-43ccda887385 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:50.471855 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cd210491-0341-4c30-ac74-43ccda887385 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e" status: 200 len: 1278 microversion: 2.1 time: 0.114978 Sep 06 01:14:50.473761 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 252/521] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:50 2022] GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e => generated 1278 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:14:50.543613 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-12253023-bcf7-4238-9df5-ffef1dd06518 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:50.544638 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-12253023-bcf7-4238-9df5-ffef1dd06518 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:50.556328 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-12253023-bcf7-4238-9df5-ffef1dd06518 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:50.556821 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-12253023-bcf7-4238-9df5-ffef1dd06518 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:50.557255 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-12253023-bcf7-4238-9df5-ffef1dd06518 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:50.558116 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-12253023-bcf7-4238-9df5-ffef1dd06518 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:50.558577 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-12253023-bcf7-4238-9df5-ffef1dd06518 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:50.558999 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-12253023-bcf7-4238-9df5-ffef1dd06518 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:50.719377 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f9ebcd2e-5b1b-4569-a909-22cc5c5ed7df tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:50.720253 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f9ebcd2e-5b1b-4569-a909-22cc5c5ed7df tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:50.732662 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f9ebcd2e-5b1b-4569-a909-22cc5c5ed7df tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:50.734413 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f9ebcd2e-5b1b-4569-a909-22cc5c5ed7df tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:50.735157 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f9ebcd2e-5b1b-4569-a909-22cc5c5ed7df tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:50.736136 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f9ebcd2e-5b1b-4569-a909-22cc5c5ed7df tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:50.737286 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f9ebcd2e-5b1b-4569-a909-22cc5c5ed7df tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:50.738369 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f9ebcd2e-5b1b-4569-a909-22cc5c5ed7df tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:50.783504 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-12253023-bcf7-4238-9df5-ffef1dd06518 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:50.796388 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-12253023-bcf7-4238-9df5-ffef1dd06518 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:50.798146 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-12253023-bcf7-4238-9df5-ffef1dd06518 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:50.799780 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-12253023-bcf7-4238-9df5-ffef1dd06518 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1809 microversion: 2.20 time: 0.259784 Sep 06 01:14:50.808320 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 270/522] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:14:50 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1809 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:14:50.901186 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-f9ebcd2e-5b1b-4569-a909-22cc5c5ed7df tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:50.911394 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f9ebcd2e-5b1b-4569-a909-22cc5c5ed7df tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1372 microversion: 2.1 time: 0.196393 Sep 06 01:14:50.912331 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 253/523] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:50 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1372 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:14:50.985208 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-26063c03-c915-45e5-a8c6-a536a2e23ca9 req-880008b8-80fa-4186-b5c7-e179611deaf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dff4f970-9216-4d56-81d9-f62b12ebccff", "name": "network-vif-deleted", "tag": "e361c831-ec99-4391-ba22-77ddd7f8862c"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:14:51.024737 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-26063c03-c915-45e5-a8c6-a536a2e23ca9 req-880008b8-80fa-4186-b5c7-e179611deaf0 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:51.025341 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-26063c03-c915-45e5-a8c6-a536a2e23ca9 req-880008b8-80fa-4186-b5c7-e179611deaf0 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:51.025842 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-26063c03-c915-45e5-a8c6-a536a2e23ca9 req-880008b8-80fa-4186-b5c7-e179611deaf0 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:51.044289 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.compute.server_external_events [req-26063c03-c915-45e5-a8c6-a536a2e23ca9 req-880008b8-80fa-4186-b5c7-e179611deaf0 service nova] Creating event network-vif-deleted:e361c831-ec99-4391-ba22-77ddd7f8862c for instance dff4f970-9216-4d56-81d9-f62b12ebccff on hv-cinder-84773 Sep 06 01:14:51.049871 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [req-26063c03-c915-45e5-a8c6-a536a2e23ca9 req-880008b8-80fa-4186-b5c7-e179611deaf0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068765 Sep 06 01:14:51.051016 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 271/524] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:14:51.440132 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9103132e-697f-40aa-bfec-d2ec16de4f8b tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:51.441461 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9103132e-697f-40aa-bfec-d2ec16de4f8b tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] [instance: dff4f970-9216-4d56-81d9-f62b12ebccff] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:51.450816 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9103132e-697f-40aa-bfec-d2ec16de4f8b tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:51.451336 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9103132e-697f-40aa-bfec-d2ec16de4f8b tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:51.451945 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9103132e-697f-40aa-bfec-d2ec16de4f8b tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:51.452864 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9103132e-697f-40aa-bfec-d2ec16de4f8b tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:51.453428 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9103132e-697f-40aa-bfec-d2ec16de4f8b tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:51.453947 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9103132e-697f-40aa-bfec-d2ec16de4f8b tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:51.496203 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-9d7377ce-413d-430f-ab92-d613b9b33308 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:51.496903 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-9d7377ce-413d-430f-ab92-d613b9b33308 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 70d2092a-968f-45aa-a07c-ee3b6f1a918e] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:51.507632 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9d7377ce-413d-430f-ab92-d613b9b33308 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:51.511938 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9d7377ce-413d-430f-ab92-d613b9b33308 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:51.518729 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9d7377ce-413d-430f-ab92-d613b9b33308 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:51.520535 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9d7377ce-413d-430f-ab92-d613b9b33308 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:51.521098 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9d7377ce-413d-430f-ab92-d613b9b33308 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:51.522544 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9d7377ce-413d-430f-ab92-d613b9b33308 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:51.528036 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-9103132e-697f-40aa-bfec-d2ec16de4f8b tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c48bdc1644230a97a6d9b8fe8f9f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd22b3b78f416ab10fd92ac92a5589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:51.536661 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9103132e-697f-40aa-bfec-d2ec16de4f8b tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] 10.222.0.23 "GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff" status: 200 len: 1299 microversion: 2.1 time: 0.100915 Sep 06 01:14:51.550516 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 254/525] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:51 2022] GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff => generated 1299 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:51.673505 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-9d7377ce-413d-430f-ab92-d613b9b33308 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:51.695545 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-9d7377ce-413d-430f-ab92-d613b9b33308 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e" status: 200 len: 1288 microversion: 2.1 time: 0.203671 Sep 06 01:14:51.696783 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 272/526] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:51 2022] GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e => generated 1288 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:51.827396 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-87947805-1121-4cdd-8989-5dd4fee8846d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:51.829429 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-87947805-1121-4cdd-8989-5dd4fee8846d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:51.837027 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87947805-1121-4cdd-8989-5dd4fee8846d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:51.837858 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87947805-1121-4cdd-8989-5dd4fee8846d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:51.838584 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87947805-1121-4cdd-8989-5dd4fee8846d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:51.840308 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87947805-1121-4cdd-8989-5dd4fee8846d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:51.840950 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87947805-1121-4cdd-8989-5dd4fee8846d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:51.841620 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87947805-1121-4cdd-8989-5dd4fee8846d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:51.934501 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-8df56c64-c51a-4f79-9aca-eb0d7a3b716b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:51.935456 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-8df56c64-c51a-4f79-9aca-eb0d7a3b716b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:51.947010 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8df56c64-c51a-4f79-9aca-eb0d7a3b716b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:51.947522 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8df56c64-c51a-4f79-9aca-eb0d7a3b716b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:51.947998 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8df56c64-c51a-4f79-9aca-eb0d7a3b716b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:51.948726 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8df56c64-c51a-4f79-9aca-eb0d7a3b716b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:51.949184 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8df56c64-c51a-4f79-9aca-eb0d7a3b716b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:51.950060 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8df56c64-c51a-4f79-9aca-eb0d7a3b716b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:52.139726 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-87947805-1121-4cdd-8989-5dd4fee8846d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:52.150052 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-87947805-1121-4cdd-8989-5dd4fee8846d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:52.152374 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-87947805-1121-4cdd-8989-5dd4fee8846d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:52.154400 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-87947805-1121-4cdd-8989-5dd4fee8846d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1809 microversion: 2.20 time: 0.332293 Sep 06 01:14:52.160489 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-8df56c64-c51a-4f79-9aca-eb0d7a3b716b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:52.173539 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 255/527] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:14:51 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1809 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:14:52.181270 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-8df56c64-c51a-4f79-9aca-eb0d7a3b716b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1567 microversion: 2.1 time: 0.250587 Sep 06 01:14:52.187793 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 273/528] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:51 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1567 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:14:52.206853 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b7cdfd41-a9af-430c-a82c-faefb4eea099 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:52.207681 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b7cdfd41-a9af-430c-a82c-faefb4eea099 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:52.214400 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7cdfd41-a9af-430c-a82c-faefb4eea099 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:52.215012 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7cdfd41-a9af-430c-a82c-faefb4eea099 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:52.215459 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7cdfd41-a9af-430c-a82c-faefb4eea099 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:52.216189 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7cdfd41-a9af-430c-a82c-faefb4eea099 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:52.216649 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7cdfd41-a9af-430c-a82c-faefb4eea099 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:52.217076 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7cdfd41-a9af-430c-a82c-faefb4eea099 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:52.304934 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b7cdfd41-a9af-430c-a82c-faefb4eea099 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.105001 Sep 06 01:14:52.305581 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 256/529] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Sep 6 01:14:52 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:14:52.565373 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-9aa55c6d-ba06-4513-9b51-47bb31a604bd tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:52.568329 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-9aa55c6d-ba06-4513-9b51-47bb31a604bd tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] [instance: dff4f970-9216-4d56-81d9-f62b12ebccff] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:52.598365 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9aa55c6d-ba06-4513-9b51-47bb31a604bd tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:52.600492 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9aa55c6d-ba06-4513-9b51-47bb31a604bd tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:52.601612 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9aa55c6d-ba06-4513-9b51-47bb31a604bd tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:52.602589 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9aa55c6d-ba06-4513-9b51-47bb31a604bd tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:52.603126 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9aa55c6d-ba06-4513-9b51-47bb31a604bd tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:52.603614 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9aa55c6d-ba06-4513-9b51-47bb31a604bd tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:52.614074 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell1:SELECT=100 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:52.653192 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9aa55c6d-ba06-4513-9b51-47bb31a604bd tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:52.653677 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9aa55c6d-ba06-4513-9b51-47bb31a604bd tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:52.654111 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9aa55c6d-ba06-4513-9b51-47bb31a604bd tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:52.654559 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.objects.instance [None req-9aa55c6d-ba06-4513-9b51-47bb31a604bd tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lazy-loading 'fault' on Instance uuid dff4f970-9216-4d56-81d9-f62b12ebccff {{(pid=120580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 01:14:52.713144 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-9aa55c6d-ba06-4513-9b51-47bb31a604bd tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c48bdc1644230a97a6d9b8fe8f9f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd22b3b78f416ab10fd92ac92a5589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:52.720953 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8c0b107e-6551-4b7b-bc41-d5d0237ef2aa tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:52.721627 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-9aa55c6d-ba06-4513-9b51-47bb31a604bd tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] 10.222.0.23 "GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff" status: 200 len: 1304 microversion: 2.1 time: 0.165182 Sep 06 01:14:52.723827 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8c0b107e-6551-4b7b-bc41-d5d0237ef2aa tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 70d2092a-968f-45aa-a07c-ee3b6f1a918e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:52.727398 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 274/530] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:52 2022] GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff => generated 1304 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:52.750220 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c0b107e-6551-4b7b-bc41-d5d0237ef2aa tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:52.750760 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c0b107e-6551-4b7b-bc41-d5d0237ef2aa tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:52.751201 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c0b107e-6551-4b7b-bc41-d5d0237ef2aa tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:52.751994 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c0b107e-6551-4b7b-bc41-d5d0237ef2aa tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:52.752611 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c0b107e-6551-4b7b-bc41-d5d0237ef2aa tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:52.753175 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c0b107e-6551-4b7b-bc41-d5d0237ef2aa tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:53.062318 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-8c0b107e-6551-4b7b-bc41-d5d0237ef2aa tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:53.070641 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8c0b107e-6551-4b7b-bc41-d5d0237ef2aa tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e" status: 200 len: 1318 microversion: 2.1 time: 0.353461 Sep 06 01:14:53.079022 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 257/531] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:52 2022] GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e => generated 1318 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:14:53.114355 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-01270e1d-4619-49ab-87f8-6f431ec28fc9 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:14:53.137512 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-01270e1d-4619-49ab-87f8-6f431ec28fc9 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:53.138014 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-01270e1d-4619-49ab-87f8-6f431ec28fc9 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:53.138459 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-01270e1d-4619-49ab-87f8-6f431ec28fc9 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:53.187447 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-39e75537-ca71-42ff-8b98-a1738c22ccb7 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:53.199372 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-39e75537-ca71-42ff-8b98-a1738c22ccb7 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:53.213478 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-01270e1d-4619-49ab-87f8-6f431ec28fc9 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Going to try to stop instance {{(pid=120580) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 06 01:14:53.225823 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39e75537-ca71-42ff-8b98-a1738c22ccb7 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:53.240424 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39e75537-ca71-42ff-8b98-a1738c22ccb7 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:53.241162 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39e75537-ca71-42ff-8b98-a1738c22ccb7 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:53.242133 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39e75537-ca71-42ff-8b98-a1738c22ccb7 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:53.242747 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39e75537-ca71-42ff-8b98-a1738c22ccb7 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:53.243346 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39e75537-ca71-42ff-8b98-a1738c22ccb7 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:53.299790 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-01270e1d-4619-49ab-87f8-6f431ec28fc9 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "POST /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba/action" status: 202 len: 0 microversion: 2.1 time: 0.199403 Sep 06 01:14:53.303871 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 275/532] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Sep 6 01:14:53 2022] POST /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 01:14:53.310369 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-26bc8ec3-6d5d-4513-84c5-cd37bc5c23de tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:53.313739 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-26bc8ec3-6d5d-4513-84c5-cd37bc5c23de tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:53.323563 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-26bc8ec3-6d5d-4513-84c5-cd37bc5c23de tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:53.324446 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-26bc8ec3-6d5d-4513-84c5-cd37bc5c23de tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:53.325142 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-26bc8ec3-6d5d-4513-84c5-cd37bc5c23de tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:53.326093 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-26bc8ec3-6d5d-4513-84c5-cd37bc5c23de tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:53.326767 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-26bc8ec3-6d5d-4513-84c5-cd37bc5c23de tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:53.327404 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-26bc8ec3-6d5d-4513-84c5-cd37bc5c23de tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:53.526410 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-39e75537-ca71-42ff-8b98-a1738c22ccb7 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:53.541462 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-39e75537-ca71-42ff-8b98-a1738c22ccb7 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:53.543315 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-39e75537-ca71-42ff-8b98-a1738c22ccb7 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:53.544647 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-39e75537-ca71-42ff-8b98-a1738c22ccb7 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1809 microversion: 2.20 time: 0.361115 Sep 06 01:14:53.545399 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 258/533] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:14:53 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1809 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:14:53.575422 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-26bc8ec3-6d5d-4513-84c5-cd37bc5c23de tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:53.588227 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-26bc8ec3-6d5d-4513-84c5-cd37bc5c23de tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1722 microversion: 2.1 time: 0.282627 Sep 06 01:14:53.589079 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 276/534] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:53 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1722 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:53.751124 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0fe6d3ec-749d-4a3e-bb57-6ff412cff1b6 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:53.752396 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0fe6d3ec-749d-4a3e-bb57-6ff412cff1b6 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] [instance: dff4f970-9216-4d56-81d9-f62b12ebccff] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:53.759438 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0fe6d3ec-749d-4a3e-bb57-6ff412cff1b6 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:53.760036 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0fe6d3ec-749d-4a3e-bb57-6ff412cff1b6 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:53.760543 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0fe6d3ec-749d-4a3e-bb57-6ff412cff1b6 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:53.761167 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0fe6d3ec-749d-4a3e-bb57-6ff412cff1b6 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:53.761625 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0fe6d3ec-749d-4a3e-bb57-6ff412cff1b6 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:53.762049 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0fe6d3ec-749d-4a3e-bb57-6ff412cff1b6 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:53.798445 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0fe6d3ec-749d-4a3e-bb57-6ff412cff1b6 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:53.798907 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0fe6d3ec-749d-4a3e-bb57-6ff412cff1b6 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:53.799377 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0fe6d3ec-749d-4a3e-bb57-6ff412cff1b6 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:53.800000 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-0fe6d3ec-749d-4a3e-bb57-6ff412cff1b6 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lazy-loading 'fault' on Instance uuid dff4f970-9216-4d56-81d9-f62b12ebccff {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 01:14:53.843889 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-0fe6d3ec-749d-4a3e-bb57-6ff412cff1b6 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67c48bdc1644230a97a6d9b8fe8f9f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffd22b3b78f416ab10fd92ac92a5589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:53.852436 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0fe6d3ec-749d-4a3e-bb57-6ff412cff1b6 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] 10.222.0.23 "GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff" status: 200 len: 1304 microversion: 2.1 time: 0.105389 Sep 06 01:14:53.853330 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 259/535] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:53 2022] GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:53.898810 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-8c79d1d9-c339-4958-85dc-6cc1a73405bb tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Action: 'create', calling method: .version_select at 0x7fb06e3419d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1401040889", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMT0RGvVMcFs/HVGAB0UYQ40urQVrzGi7iQJ8PWsIDgLYregtFzqzZAhcsTrtZIYyNjftBkowGUV9X57f91apgpVgb6p/ndOWdd688JI72CFER8MnV/V1Ly1B5wizxcRw=="}} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:14:53.914351 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.quota [None req-8c79d1d9-c339-4958-85dc-6cc1a73405bb tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Getting quotas for project 25d31e6f0604458f8b9a36e2de86ff1f. Resources: {'key_pairs'} {{(pid=120580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 01:14:53.918498 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.quota [None req-8c79d1d9-c339-4958-85dc-6cc1a73405bb tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Getting quotas for user 18c5c95fde3646409d542da0ff274883 and project 25d31e6f0604458f8b9a36e2de86ff1f. Resources: {'key_pairs'} {{(pid=120580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 01:14:53.945082 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-8c79d1d9-c339-4958-85dc-6cc1a73405bb tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.050643 Sep 06 01:14:53.951905 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 277/536] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Sep 6 01:14:53 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:14:53.997369 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-439f1f10-c6d8-4ff2-868c-18ef9c4ed522 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1810463600", "imageRef": "c6e5f6ff-7690-40be-9be0-c3622917dd76", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1401040889", "networks": [{"uuid": "3c64d519-3535-4fcc-a4b2-c8f2e56e4998"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:14:54.051577 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-439f1f10-c6d8-4ff2-868c-18ef9c4ed522 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] validate_networks() for [('3c64d519-3535-4fcc-a4b2-c8f2e56e4998', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 01:14:54.096244 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-cb5850c0-8262-4637-8979-e5b7802582ec tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:54.097376 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-cb5850c0-8262-4637-8979-e5b7802582ec tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 70d2092a-968f-45aa-a07c-ee3b6f1a918e] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:54.103940 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cb5850c0-8262-4637-8979-e5b7802582ec tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:54.104920 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cb5850c0-8262-4637-8979-e5b7802582ec tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:54.105039 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cb5850c0-8262-4637-8979-e5b7802582ec tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:54.105879 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cb5850c0-8262-4637-8979-e5b7802582ec tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:54.106512 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cb5850c0-8262-4637-8979-e5b7802582ec tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:54.106747 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cb5850c0-8262-4637-8979-e5b7802582ec tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:54.387982 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-cb5850c0-8262-4637-8979-e5b7802582ec tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:54.395697 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-cb5850c0-8262-4637-8979-e5b7802582ec tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e" status: 200 len: 1318 microversion: 2.1 time: 0.304041 Sep 06 01:14:54.396301 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 278/537] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:54 2022] GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e => generated 1318 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:14:54.409015 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-7c90e91e-dc5e-4e99-acc2-67f589898a1a req-ac987412-d76d-498e-baef-224e3ff58baa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70d2092a-968f-45aa-a07c-ee3b6f1a918e", "tag": "4b2f4d5d-3bb2-4d5b-8556-4b9eb01d4509"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:14:54.430518 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-7c90e91e-dc5e-4e99-acc2-67f589898a1a req-ac987412-d76d-498e-baef-224e3ff58baa service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:54.431014 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-7c90e91e-dc5e-4e99-acc2-67f589898a1a req-ac987412-d76d-498e-baef-224e3ff58baa service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:54.431452 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-7c90e91e-dc5e-4e99-acc2-67f589898a1a req-ac987412-d76d-498e-baef-224e3ff58baa service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:54.474222 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.compute.server_external_events [req-7c90e91e-dc5e-4e99-acc2-67f589898a1a req-ac987412-d76d-498e-baef-224e3ff58baa service nova] Creating event network-changed:4b2f4d5d-3bb2-4d5b-8556-4b9eb01d4509 for instance 70d2092a-968f-45aa-a07c-ee3b6f1a918e on hv-cinder-84773 Sep 06 01:14:54.480786 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [req-7c90e91e-dc5e-4e99-acc2-67f589898a1a req-ac987412-d76d-498e-baef-224e3ff58baa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081283 Sep 06 01:14:54.483173 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 279/538] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:14:54.584665 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-b4c62785-93f5-440c-99c3-0a3e38c48b5f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:54.585275 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-b4c62785-93f5-440c-99c3-0a3e38c48b5f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:54.601577 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b4c62785-93f5-440c-99c3-0a3e38c48b5f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:54.602930 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b4c62785-93f5-440c-99c3-0a3e38c48b5f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:54.603989 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b4c62785-93f5-440c-99c3-0a3e38c48b5f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:54.606414 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b4c62785-93f5-440c-99c3-0a3e38c48b5f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:54.606414 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b4c62785-93f5-440c-99c3-0a3e38c48b5f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:54.606414 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b4c62785-93f5-440c-99c3-0a3e38c48b5f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:54.662318 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-439f1f10-c6d8-4ff2-868c-18ef9c4ed522 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 01:14:54.662758 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-439f1f10-c6d8-4ff2-868c-18ef9c4ed522 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 01:14:54.663234 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-439f1f10-c6d8-4ff2-868c-18ef9c4ed522 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 01:14:54.663663 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-439f1f10-c6d8-4ff2-868c-18ef9c4ed522 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 01:14:54.664107 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-439f1f10-c6d8-4ff2-868c-18ef9c4ed522 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 01:14:54.674718 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-439f1f10-c6d8-4ff2-868c-18ef9c4ed522 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:54.675262 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-439f1f10-c6d8-4ff2-868c-18ef9c4ed522 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:54.681356 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-439f1f10-c6d8-4ff2-868c-18ef9c4ed522 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:54.682178 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-439f1f10-c6d8-4ff2-868c-18ef9c4ed522 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:54.682661 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-439f1f10-c6d8-4ff2-868c-18ef9c4ed522 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:54.683099 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-439f1f10-c6d8-4ff2-868c-18ef9c4ed522 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:54.709057 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.quota [None req-439f1f10-c6d8-4ff2-868c-18ef9c4ed522 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Getting quotas for project 25d31e6f0604458f8b9a36e2de86ff1f. Resources: {'instances', 'ram', 'cores'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 01:14:54.714453 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.quota [None req-439f1f10-c6d8-4ff2-868c-18ef9c4ed522 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Getting quotas for user 18c5c95fde3646409d542da0ff274883 and project 25d31e6f0604458f8b9a36e2de86ff1f. Resources: {'instances', 'ram', 'cores'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 01:14:54.728883 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-439f1f10-c6d8-4ff2-868c-18ef9c4ed522 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 01:14:54.731467 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-439f1f10-c6d8-4ff2-868c-18ef9c4ed522 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6e5f6ff-7690-40be-9be0-c3622917dd76',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 01:14:54.782843 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-439f1f10-c6d8-4ff2-868c-18ef9c4ed522 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.789241 Sep 06 01:14:54.784741 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 260/539] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Sep 6 01:14:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 01:14:54.789570 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d3f89912-cb9b-4190-a169-0b02eae2d474 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:54.790463 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d3f89912-cb9b-4190-a169-0b02eae2d474 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:54.799289 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d3f89912-cb9b-4190-a169-0b02eae2d474 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:54.800179 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d3f89912-cb9b-4190-a169-0b02eae2d474 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:54.800838 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d3f89912-cb9b-4190-a169-0b02eae2d474 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:54.801780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d3f89912-cb9b-4190-a169-0b02eae2d474 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:54.802517 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d3f89912-cb9b-4190-a169-0b02eae2d474 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:54.803017 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d3f89912-cb9b-4190-a169-0b02eae2d474 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:54.835146 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-b4c62785-93f5-440c-99c3-0a3e38c48b5f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:54.848987 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-b4c62785-93f5-440c-99c3-0a3e38c48b5f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:54.850713 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-b4c62785-93f5-440c-99c3-0a3e38c48b5f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:54.852644 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-b4c62785-93f5-440c-99c3-0a3e38c48b5f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1809 microversion: 2.20 time: 0.282296 Sep 06 01:14:54.854222 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 280/540] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:14:54 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1809 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:14:54.859993 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-4bd1a7ce-e30b-46f2-ac04-8304166b2c06 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:54.860859 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-4bd1a7ce-e30b-46f2-ac04-8304166b2c06 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:54.929156 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-4bd1a7ce-e30b-46f2-ac04-8304166b2c06 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:54.936052 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-4bd1a7ce-e30b-46f2-ac04-8304166b2c06 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1259 microversion: 2.1 time: 0.080609 Sep 06 01:14:54.936947 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 281/541] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:54 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1259 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:54.942950 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-840b69f2-97d7-49f1-ac65-dcd5efc92749 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:54.943803 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-840b69f2-97d7-49f1-ac65-dcd5efc92749 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] [instance: dff4f970-9216-4d56-81d9-f62b12ebccff] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:54.951777 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-840b69f2-97d7-49f1-ac65-dcd5efc92749 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:54.952535 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-840b69f2-97d7-49f1-ac65-dcd5efc92749 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:54.953184 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-840b69f2-97d7-49f1-ac65-dcd5efc92749 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:54.954253 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-840b69f2-97d7-49f1-ac65-dcd5efc92749 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:54.954893 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-840b69f2-97d7-49f1-ac65-dcd5efc92749 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:54.955557 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-840b69f2-97d7-49f1-ac65-dcd5efc92749 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:54.976258 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.wsgi [None req-840b69f2-97d7-49f1-ac65-dcd5efc92749 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] HTTP exception thrown: Instance dff4f970-9216-4d56-81d9-f62b12ebccff could not be found. Sep 06 01:14:54.978530 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-840b69f2-97d7-49f1-ac65-dcd5efc92749 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Request method failure captured: Sep 06 01:14:54.978530 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: request: GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff HTTP/1.1 Sep 06 01:14:54.978530 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept: application/json Sep 06 01:14:54.978530 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept-Encoding: identity Sep 06 01:14:54.978530 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Connection: close Sep 06 01:14:54.978530 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Length: 0 Sep 06 01:14:54.978530 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Type: application/json Sep 06 01:14:54.978530 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Host: 10.222.0.23 Sep 06 01:14:54.978530 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Openstack-System-Scope: None Sep 06 01:14:54.978530 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: User-Agent: python-urllib3/1.26.12 Sep 06 01:14:54.978530 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Auth-Token: gAAAAABjFp7hWV__mvhBvAQeirLYbiKLEWFMXDhVOm7kcxmUFJ-MSkr2ynPPbQjt8Y3M4gtvd-mnM0yvUOBcOVArLN1_VjkkcUUXPJZoTbsIJkN0XlfTdwoc7iPrY07vI759G4S_BtkkDN-73aUQ2UokXmcTeqdi3zF1lA_e64Do8owHOBx-Jdc Sep 06 01:14:54.978530 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Id: None Sep 06 01:14:54.978530 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Name: None Sep 06 01:14:54.978530 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Identity-Status: Confirmed Sep 06 01:14:54.978530 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Is-Admin-Project: True Sep 06 01:14:54.978530 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Id: default Sep 06 01:14:54.978530 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Name: Default Sep 06 01:14:54.978530 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Id: cffd22b3b78f416ab10fd92ac92a5589 Sep 06 01:14:54.978530 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Name: tempest-VolumesNegativeTest-1685563899 Sep 06 01:14:54.978530 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Role: reader,member Sep 06 01:14:54.978530 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Roles: reader,member Sep 06 01:14:54.979950 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cffd22b3b78f416ab10fd92ac92a5589"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cffd22b3b78f416ab10fd92ac92a5589"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cffd22b3b78f416ab10fd92ac92a5589"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cffd22b3b78f416ab10fd92ac92a5589"}]}] Sep 06 01:14:54.979950 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant: tempest-VolumesNegativeTest-1685563899 Sep 06 01:14:54.979950 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Id: cffd22b3b78f416ab10fd92ac92a5589 Sep 06 01:14:54.979950 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Name: tempest-VolumesNegativeTest-1685563899 Sep 06 01:14:54.979950 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User: tempest-VolumesNegativeTest-1685563899-project Sep 06 01:14:54.979950 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Id: default Sep 06 01:14:54.979950 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Name: Default Sep 06 01:14:54.979950 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Id: f67c48bdc1644230a97a6d9b8fe8f9f3 Sep 06 01:14:54.979950 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Name: tempest-VolumesNegativeTest-1685563899-project Sep 06 01:14:54.979950 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: method: > Sep 06 01:14:54.979950 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: exception: Instance dff4f970-9216-4d56-81d9-f62b12ebccff could not be found. Sep 06 01:14:54.979950 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: action_args: {'id': 'dff4f970-9216-4d56-81d9-f62b12ebccff'} Sep 06 01:14:54.980965 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:14:54.980965 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:14:54.980965 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 01:14:54.980965 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 01:14:54.980965 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 01:14:54.980965 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 01:14:54.980965 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 01:14:54.980965 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 01:14:54.980965 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 01:14:54.980965 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 01:14:54.980965 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dff4f970-9216-4d56-81d9-f62b12ebccff could not be found. Sep 06 01:14:54.980965 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:14:54.980965 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:14:54.980965 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:14:54.980965 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:14:54.980965 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:14:54.980965 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:14:54.980965 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:14:54.980965 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:14:54.980965 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:14:54.982141 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:14:54.982141 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 01:14:54.982141 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 01:14:54.982141 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 01:14:54.982141 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 01:14:54.982141 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 01:14:54.982141 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:14:54.982141 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dff4f970-9216-4d56-81d9-f62b12ebccff could not be found. Sep 06 01:14:54.982141 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:14:54.982141 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:14:54.982141 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:14:54.982141 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:14:54.982141 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:14:54.982141 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:14:54.982141 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:14:54.982141 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:14:54.982141 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dff4f970-9216-4d56-81d9-f62b12ebccff could not be found. Sep 06 01:14:54.982141 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:14:54.986273 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-840b69f2-97d7-49f1-ac65-dcd5efc92749 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] Returning 404 to user: Instance dff4f970-9216-4d56-81d9-f62b12ebccff could not be found. {{(pid=120580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:14:54.987320 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-840b69f2-97d7-49f1-ac65-dcd5efc92749 tempest-VolumesNegativeTest-1685563899 tempest-VolumesNegativeTest-1685563899-project] 10.222.0.23 "GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff" status: 404 len: 111 microversion: 2.1 time: 0.049326 Sep 06 01:14:54.991082 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-d3f89912-cb9b-4190-a169-0b02eae2d474 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:54.992191 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 282/542] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:54 2022] GET /compute/v2.1/servers/dff4f970-9216-4d56-81d9-f62b12ebccff => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 01:14:55.010120 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d3f89912-cb9b-4190-a169-0b02eae2d474 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1722 microversion: 2.1 time: 0.224087 Sep 06 01:14:55.011224 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 261/543] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:54 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:55.418582 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-02b19c45-7977-4b3e-9a63-855c95b6a45c tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:55.419211 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-02b19c45-7977-4b3e-9a63-855c95b6a45c tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 70d2092a-968f-45aa-a07c-ee3b6f1a918e] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:55.425723 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-02b19c45-7977-4b3e-9a63-855c95b6a45c tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:55.426234 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-02b19c45-7977-4b3e-9a63-855c95b6a45c tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:55.426674 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-02b19c45-7977-4b3e-9a63-855c95b6a45c tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:55.427362 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-02b19c45-7977-4b3e-9a63-855c95b6a45c tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:55.427838 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-02b19c45-7977-4b3e-9a63-855c95b6a45c tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:55.428263 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-02b19c45-7977-4b3e-9a63-855c95b6a45c tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:55.570601 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-02b19c45-7977-4b3e-9a63-855c95b6a45c tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:55.579836 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-02b19c45-7977-4b3e-9a63-855c95b6a45c tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e" status: 200 len: 1318 microversion: 2.1 time: 0.165258 Sep 06 01:14:55.586915 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 283/544] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:55 2022] GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:55.882404 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fff2ed96-125a-4454-9a69-df4aadfedf62 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:55.883018 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fff2ed96-125a-4454-9a69-df4aadfedf62 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:55.889731 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fff2ed96-125a-4454-9a69-df4aadfedf62 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:55.890220 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fff2ed96-125a-4454-9a69-df4aadfedf62 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:55.890653 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fff2ed96-125a-4454-9a69-df4aadfedf62 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:55.891342 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fff2ed96-125a-4454-9a69-df4aadfedf62 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:55.891821 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fff2ed96-125a-4454-9a69-df4aadfedf62 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:55.892246 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fff2ed96-125a-4454-9a69-df4aadfedf62 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:55.960400 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-38073e26-dcd2-43e2-82f6-5ec447edcc9e tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:55.961157 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-38073e26-dcd2-43e2-82f6-5ec447edcc9e tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:55.967217 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-38073e26-dcd2-43e2-82f6-5ec447edcc9e tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:55.967815 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-38073e26-dcd2-43e2-82f6-5ec447edcc9e tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:55.968486 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-38073e26-dcd2-43e2-82f6-5ec447edcc9e tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:55.969390 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-38073e26-dcd2-43e2-82f6-5ec447edcc9e tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:55.969918 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-38073e26-dcd2-43e2-82f6-5ec447edcc9e tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:55.970586 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-38073e26-dcd2-43e2-82f6-5ec447edcc9e tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:56.039236 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-38073e26-dcd2-43e2-82f6-5ec447edcc9e tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:56.047435 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-38073e26-dcd2-43e2-82f6-5ec447edcc9e tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1263 microversion: 2.1 time: 0.091795 Sep 06 01:14:56.048203 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 284/545] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:55 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1263 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:14:56.054124 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-fff2ed96-125a-4454-9a69-df4aadfedf62 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:56.063188 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-fff2ed96-125a-4454-9a69-df4aadfedf62 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:56.063626 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-3949d6f3-f308-4944-976e-62c0c762be5d tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:56.064299 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-3949d6f3-f308-4944-976e-62c0c762be5d tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:56.064918 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-fff2ed96-125a-4454-9a69-df4aadfedf62 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:56.066113 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fff2ed96-125a-4454-9a69-df4aadfedf62 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1809 microversion: 2.20 time: 0.187701 Sep 06 01:14:56.068201 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 262/546] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:14:55 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1809 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:14:56.070309 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3949d6f3-f308-4944-976e-62c0c762be5d tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:56.070787 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3949d6f3-f308-4944-976e-62c0c762be5d tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:56.071217 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3949d6f3-f308-4944-976e-62c0c762be5d tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:56.072563 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3949d6f3-f308-4944-976e-62c0c762be5d tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:56.073019 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3949d6f3-f308-4944-976e-62c0c762be5d tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:56.073443 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3949d6f3-f308-4944-976e-62c0c762be5d tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:56.207008 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-3949d6f3-f308-4944-976e-62c0c762be5d tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:56.215543 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-3949d6f3-f308-4944-976e-62c0c762be5d tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1722 microversion: 2.1 time: 0.162377 Sep 06 01:14:56.216123 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 285/547] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:56 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:56.496872 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-806855eb-14b2-4143-bc45-d4da5cf413ca req-fcfc537d-39a3-4a38-a29a-0a234a9ad7dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce3f054d-45b3-41c2-9f87-c32efa7bc088", "tag": "5bfb66f4-238b-4ee5-8ff6-581b693fd4eb"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:14:56.507291 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-806855eb-14b2-4143-bc45-d4da5cf413ca req-fcfc537d-39a3-4a38-a29a-0a234a9ad7dc service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:56.508012 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-806855eb-14b2-4143-bc45-d4da5cf413ca req-fcfc537d-39a3-4a38-a29a-0a234a9ad7dc service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:56.508607 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-806855eb-14b2-4143-bc45-d4da5cf413ca req-fcfc537d-39a3-4a38-a29a-0a234a9ad7dc service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:56.520822 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-806855eb-14b2-4143-bc45-d4da5cf413ca req-fcfc537d-39a3-4a38-a29a-0a234a9ad7dc service nova] Creating event network-changed:5bfb66f4-238b-4ee5-8ff6-581b693fd4eb for instance ce3f054d-45b3-41c2-9f87-c32efa7bc088 on hv-cinder-84773 Sep 06 01:14:56.526221 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-806855eb-14b2-4143-bc45-d4da5cf413ca req-fcfc537d-39a3-4a38-a29a-0a234a9ad7dc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033084 Sep 06 01:14:56.527325 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 263/548] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:14:56.603116 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-9a9b0230-4d26-458d-b673-1470b0d92be3 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:56.603874 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-9a9b0230-4d26-458d-b673-1470b0d92be3 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 70d2092a-968f-45aa-a07c-ee3b6f1a918e] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:56.614040 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9a9b0230-4d26-458d-b673-1470b0d92be3 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:56.614596 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9a9b0230-4d26-458d-b673-1470b0d92be3 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:56.615168 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9a9b0230-4d26-458d-b673-1470b0d92be3 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:56.615987 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9a9b0230-4d26-458d-b673-1470b0d92be3 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:56.616523 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9a9b0230-4d26-458d-b673-1470b0d92be3 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:56.617043 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9a9b0230-4d26-458d-b673-1470b0d92be3 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:56.797337 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-9a9b0230-4d26-458d-b673-1470b0d92be3 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:56.808747 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-9a9b0230-4d26-458d-b673-1470b0d92be3 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e" status: 200 len: 1318 microversion: 2.1 time: 0.209932 Sep 06 01:14:56.810053 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 286/549] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:56 2022] GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:57.071124 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-18b6dbf2-0b8f-4e39-b993-120882ecf89c tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:57.071889 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-18b6dbf2-0b8f-4e39-b993-120882ecf89c tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:57.077942 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18b6dbf2-0b8f-4e39-b993-120882ecf89c tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:57.078423 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18b6dbf2-0b8f-4e39-b993-120882ecf89c tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:57.078859 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18b6dbf2-0b8f-4e39-b993-120882ecf89c tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:57.079548 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18b6dbf2-0b8f-4e39-b993-120882ecf89c tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:57.080036 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18b6dbf2-0b8f-4e39-b993-120882ecf89c tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:57.080464 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18b6dbf2-0b8f-4e39-b993-120882ecf89c tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:57.091831 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-a29ca99e-c816-4cee-822d-abd0cbbec964 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:57.093129 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-a29ca99e-c816-4cee-822d-abd0cbbec964 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:57.103020 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a29ca99e-c816-4cee-822d-abd0cbbec964 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:57.103505 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a29ca99e-c816-4cee-822d-abd0cbbec964 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:57.103965 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a29ca99e-c816-4cee-822d-abd0cbbec964 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:57.114183 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a29ca99e-c816-4cee-822d-abd0cbbec964 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:57.114723 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a29ca99e-c816-4cee-822d-abd0cbbec964 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:57.115170 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a29ca99e-c816-4cee-822d-abd0cbbec964 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:57.147001 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-18b6dbf2-0b8f-4e39-b993-120882ecf89c tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:57.155291 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-18b6dbf2-0b8f-4e39-b993-120882ecf89c tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1311 microversion: 2.1 time: 0.088741 Sep 06 01:14:57.158365 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 264/550] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:57 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1311 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:57.239149 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fffc9cac-5be9-41ab-9d30-41a60aace78f tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:57.239679 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fffc9cac-5be9-41ab-9d30-41a60aace78f tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:57.243016 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:57.246515 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fffc9cac-5be9-41ab-9d30-41a60aace78f tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:57.247014 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fffc9cac-5be9-41ab-9d30-41a60aace78f tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:57.247541 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fffc9cac-5be9-41ab-9d30-41a60aace78f tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:57.248233 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fffc9cac-5be9-41ab-9d30-41a60aace78f tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:57.250961 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-a29ca99e-c816-4cee-822d-abd0cbbec964 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:57.251319 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fffc9cac-5be9-41ab-9d30-41a60aace78f tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:57.252016 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fffc9cac-5be9-41ab-9d30-41a60aace78f tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:57.261836 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-a29ca99e-c816-4cee-822d-abd0cbbec964 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:57.263926 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-a29ca99e-c816-4cee-822d-abd0cbbec964 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:57.264942 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-a29ca99e-c816-4cee-822d-abd0cbbec964 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1809 microversion: 2.20 time: 0.177142 Sep 06 01:14:57.265831 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 287/551] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:14:57 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:14:57.410548 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-fffc9cac-5be9-41ab-9d30-41a60aace78f tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:57.422014 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fffc9cac-5be9-41ab-9d30-41a60aace78f tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1722 microversion: 2.1 time: 0.187359 Sep 06 01:14:57.423238 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 265/552] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:57 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:14:57.839111 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-eda5a60c-e2dd-4fc8-9800-0fc205b391c9 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:57.840404 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-eda5a60c-e2dd-4fc8-9800-0fc205b391c9 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 70d2092a-968f-45aa-a07c-ee3b6f1a918e] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:57.847784 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-eda5a60c-e2dd-4fc8-9800-0fc205b391c9 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:57.848706 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-eda5a60c-e2dd-4fc8-9800-0fc205b391c9 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:57.849548 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-eda5a60c-e2dd-4fc8-9800-0fc205b391c9 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:57.850516 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-eda5a60c-e2dd-4fc8-9800-0fc205b391c9 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:57.851471 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-eda5a60c-e2dd-4fc8-9800-0fc205b391c9 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:57.852193 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-eda5a60c-e2dd-4fc8-9800-0fc205b391c9 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:58.005004 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-eda5a60c-e2dd-4fc8-9800-0fc205b391c9 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:58.012785 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-eda5a60c-e2dd-4fc8-9800-0fc205b391c9 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e" status: 200 len: 1318 microversion: 2.1 time: 0.179420 Sep 06 01:14:58.013442 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 288/553] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:57 2022] GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:58.180679 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b4a394ce-9da5-47ea-90ed-f2814d8e61d0 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:58.182777 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b4a394ce-9da5-47ea-90ed-f2814d8e61d0 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:58.190146 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b4a394ce-9da5-47ea-90ed-f2814d8e61d0 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:58.191199 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b4a394ce-9da5-47ea-90ed-f2814d8e61d0 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:58.191833 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b4a394ce-9da5-47ea-90ed-f2814d8e61d0 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:58.192694 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b4a394ce-9da5-47ea-90ed-f2814d8e61d0 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:58.193338 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b4a394ce-9da5-47ea-90ed-f2814d8e61d0 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:58.193758 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b4a394ce-9da5-47ea-90ed-f2814d8e61d0 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:58.291345 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-ce7ab794-05bf-497c-8644-f960378c9ea8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:58.292045 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-ce7ab794-05bf-497c-8644-f960378c9ea8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:58.308231 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ce7ab794-05bf-497c-8644-f960378c9ea8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:58.308739 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ce7ab794-05bf-497c-8644-f960378c9ea8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:58.309374 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ce7ab794-05bf-497c-8644-f960378c9ea8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:58.310266 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ce7ab794-05bf-497c-8644-f960378c9ea8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:58.310876 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ce7ab794-05bf-497c-8644-f960378c9ea8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:58.311453 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ce7ab794-05bf-497c-8644-f960378c9ea8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:58.429699 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-b4a394ce-9da5-47ea-90ed-f2814d8e61d0 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:58.438317 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b4a394ce-9da5-47ea-90ed-f2814d8e61d0 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1359 microversion: 2.1 time: 0.263007 Sep 06 01:14:58.439259 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 266/554] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:58 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1359 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:58.446235 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d98f3975-ed0c-42f6-bceb-b326026b7fe2 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:58.446840 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d98f3975-ed0c-42f6-bceb-b326026b7fe2 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:58.453936 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d98f3975-ed0c-42f6-bceb-b326026b7fe2 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:58.454416 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d98f3975-ed0c-42f6-bceb-b326026b7fe2 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:58.454846 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d98f3975-ed0c-42f6-bceb-b326026b7fe2 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:58.455534 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d98f3975-ed0c-42f6-bceb-b326026b7fe2 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:58.456039 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d98f3975-ed0c-42f6-bceb-b326026b7fe2 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:58.456508 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d98f3975-ed0c-42f6-bceb-b326026b7fe2 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:58.492426 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-ce7ab794-05bf-497c-8644-f960378c9ea8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:58.501874 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-ce7ab794-05bf-497c-8644-f960378c9ea8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:58.503451 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-ce7ab794-05bf-497c-8644-f960378c9ea8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:58.504722 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-ce7ab794-05bf-497c-8644-f960378c9ea8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1809 microversion: 2.20 time: 0.217336 Sep 06 01:14:58.505403 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 289/555] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:14:58 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1809 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:14:58.600582 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-d98f3975-ed0c-42f6-bceb-b326026b7fe2 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:58.609051 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d98f3975-ed0c-42f6-bceb-b326026b7fe2 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1722 microversion: 2.1 time: 0.166475 Sep 06 01:14:58.609631 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 267/556] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:58 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:14:59.037311 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-3b0958e0-adf9-4c71-ab66-a217bd1ba0ad tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:59.038008 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-3b0958e0-adf9-4c71-ab66-a217bd1ba0ad tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 70d2092a-968f-45aa-a07c-ee3b6f1a918e] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:59.050883 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3b0958e0-adf9-4c71-ab66-a217bd1ba0ad tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:59.055569 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3b0958e0-adf9-4c71-ab66-a217bd1ba0ad tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:59.057106 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3b0958e0-adf9-4c71-ab66-a217bd1ba0ad tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:59.058164 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3b0958e0-adf9-4c71-ab66-a217bd1ba0ad tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:59.058808 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3b0958e0-adf9-4c71-ab66-a217bd1ba0ad tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:59.059435 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3b0958e0-adf9-4c71-ab66-a217bd1ba0ad tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:59.353492 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-3b0958e0-adf9-4c71-ab66-a217bd1ba0ad tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:59.366323 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-3b0958e0-adf9-4c71-ab66-a217bd1ba0ad tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e" status: 200 len: 1318 microversion: 2.1 time: 0.333973 Sep 06 01:14:59.367227 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 290/557] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:59 2022] GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e => generated 1318 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:59.462211 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b30c9533-e842-4340-a771-78e776791fbd tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:59.463462 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b30c9533-e842-4340-a771-78e776791fbd tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:59.476158 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b30c9533-e842-4340-a771-78e776791fbd tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:59.476883 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b30c9533-e842-4340-a771-78e776791fbd tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:59.477479 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b30c9533-e842-4340-a771-78e776791fbd tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:59.478337 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b30c9533-e842-4340-a771-78e776791fbd tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:59.484090 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b30c9533-e842-4340-a771-78e776791fbd tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:59.485235 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b30c9533-e842-4340-a771-78e776791fbd tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:59.531391 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-0d67d2ba-47c8-4a37-a0a1-62a919d40d62 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:59.533315 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-0d67d2ba-47c8-4a37-a0a1-62a919d40d62 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:59.544463 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0d67d2ba-47c8-4a37-a0a1-62a919d40d62 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:59.549096 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0d67d2ba-47c8-4a37-a0a1-62a919d40d62 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:59.549604 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0d67d2ba-47c8-4a37-a0a1-62a919d40d62 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:59.552196 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0d67d2ba-47c8-4a37-a0a1-62a919d40d62 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:59.557910 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0d67d2ba-47c8-4a37-a0a1-62a919d40d62 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:59.558361 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0d67d2ba-47c8-4a37-a0a1-62a919d40d62 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:59.861761 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-b30c9533-e842-4340-a771-78e776791fbd tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:59.869621 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b30c9533-e842-4340-a771-78e776791fbd tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1359 microversion: 2.1 time: 0.411376 Sep 06 01:14:59.889685 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 268/558] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:59 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1359 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:14:59.895072 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d98752b7-cc1e-4885-b657-a88e18cf86fb tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:14:59.895690 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d98752b7-cc1e-4885-b657-a88e18cf86fb tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:14:59.903831 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d98752b7-cc1e-4885-b657-a88e18cf86fb tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:59.906374 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d98752b7-cc1e-4885-b657-a88e18cf86fb tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:59.906991 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d98752b7-cc1e-4885-b657-a88e18cf86fb tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:59.907952 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d98752b7-cc1e-4885-b657-a88e18cf86fb tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:59.908567 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d98752b7-cc1e-4885-b657-a88e18cf86fb tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:59.909201 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d98752b7-cc1e-4885-b657-a88e18cf86fb tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:14:59.922159 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-0d67d2ba-47c8-4a37-a0a1-62a919d40d62 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:59.937005 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-0d67d2ba-47c8-4a37-a0a1-62a919d40d62 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:59.938717 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-0d67d2ba-47c8-4a37-a0a1-62a919d40d62 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:14:59.940143 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-0d67d2ba-47c8-4a37-a0a1-62a919d40d62 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1809 microversion: 2.20 time: 0.413948 Sep 06 01:14:59.943442 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 291/559] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:14:59 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1809 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:14:59.955849 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-7da8c7f6-fc39-47ec-9380-107cbd4b5548 req-146d4e91-81ea-4ba9-8413-1eb85c619eb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "590890af-37ec-4cde-b2f7-0b20cc31b43d", "tag": "c382089c-3c7e-40e3-825b-3469de858075"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:14:59.959091 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:14:59.977403 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-7da8c7f6-fc39-47ec-9380-107cbd4b5548 req-146d4e91-81ea-4ba9-8413-1eb85c619eb0 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:14:59.978149 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-7da8c7f6-fc39-47ec-9380-107cbd4b5548 req-146d4e91-81ea-4ba9-8413-1eb85c619eb0 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:14:59.978734 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-7da8c7f6-fc39-47ec-9380-107cbd4b5548 req-146d4e91-81ea-4ba9-8413-1eb85c619eb0 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:00.004737 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.compute.server_external_events [req-7da8c7f6-fc39-47ec-9380-107cbd4b5548 req-146d4e91-81ea-4ba9-8413-1eb85c619eb0 service nova] Creating event network-changed:c382089c-3c7e-40e3-825b-3469de858075 for instance 590890af-37ec-4cde-b2f7-0b20cc31b43d on hv-cinder-84773 Sep 06 01:15:00.022004 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [req-7da8c7f6-fc39-47ec-9380-107cbd4b5548 req-146d4e91-81ea-4ba9-8413-1eb85c619eb0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077014 Sep 06 01:15:00.025806 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 292/560] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:15:00.248936 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-d98752b7-cc1e-4885-b657-a88e18cf86fb tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:00.260557 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d98752b7-cc1e-4885-b657-a88e18cf86fb tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1722 microversion: 2.1 time: 0.369676 Sep 06 01:15:00.261691 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 269/561] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:14:59 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1722 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:00.368378 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-0a5ba415-37a0-41c9-8025-5fb1bb6ecc93 req-15f65696-0b6d-4926-b4f9-6a49d2d0db46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70d2092a-968f-45aa-a07c-ee3b6f1a918e", "name": "network-vif-plugged", "status": "completed", "tag": "4b2f4d5d-3bb2-4d5b-8556-4b9eb01d4509"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:15:00.392137 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-440897b7-ebcb-41c8-a8a2-b99520021306 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:00.393045 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-440897b7-ebcb-41c8-a8a2-b99520021306 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 70d2092a-968f-45aa-a07c-ee3b6f1a918e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:00.401078 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-0a5ba415-37a0-41c9-8025-5fb1bb6ecc93 req-15f65696-0b6d-4926-b4f9-6a49d2d0db46 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:00.401551 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-0a5ba415-37a0-41c9-8025-5fb1bb6ecc93 req-15f65696-0b6d-4926-b4f9-6a49d2d0db46 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:00.401981 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-0a5ba415-37a0-41c9-8025-5fb1bb6ecc93 req-15f65696-0b6d-4926-b4f9-6a49d2d0db46 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:00.403459 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-440897b7-ebcb-41c8-a8a2-b99520021306 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:00.406660 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-440897b7-ebcb-41c8-a8a2-b99520021306 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:00.407315 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-440897b7-ebcb-41c8-a8a2-b99520021306 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:00.410780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-440897b7-ebcb-41c8-a8a2-b99520021306 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:00.420422 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-440897b7-ebcb-41c8-a8a2-b99520021306 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:00.421323 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-440897b7-ebcb-41c8-a8a2-b99520021306 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:00.423414 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.compute.server_external_events [req-0a5ba415-37a0-41c9-8025-5fb1bb6ecc93 req-15f65696-0b6d-4926-b4f9-6a49d2d0db46 service nova] Creating event network-vif-plugged:4b2f4d5d-3bb2-4d5b-8556-4b9eb01d4509 for instance 70d2092a-968f-45aa-a07c-ee3b6f1a918e on hv-cinder-84773 Sep 06 01:15:00.453858 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [req-0a5ba415-37a0-41c9-8025-5fb1bb6ecc93 req-15f65696-0b6d-4926-b4f9-6a49d2d0db46 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091137 Sep 06 01:15:00.454631 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 293/562] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:15:00.723796 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-440897b7-ebcb-41c8-a8a2-b99520021306 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:00.741281 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-440897b7-ebcb-41c8-a8a2-b99520021306 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e" status: 200 len: 1318 microversion: 2.1 time: 0.353918 Sep 06 01:15:00.742821 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 270/563] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:00 2022] GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e => generated 1318 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:15:00.897832 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-6fc45dbb-769b-4bf7-89c9-0cdc70c4b277 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:00.898829 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-6fc45dbb-769b-4bf7-89c9-0cdc70c4b277 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:00.905781 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6fc45dbb-769b-4bf7-89c9-0cdc70c4b277 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:00.906500 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6fc45dbb-769b-4bf7-89c9-0cdc70c4b277 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:00.907118 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6fc45dbb-769b-4bf7-89c9-0cdc70c4b277 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:00.908163 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6fc45dbb-769b-4bf7-89c9-0cdc70c4b277 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:00.908781 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6fc45dbb-769b-4bf7-89c9-0cdc70c4b277 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:00.909896 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6fc45dbb-769b-4bf7-89c9-0cdc70c4b277 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:00.914678 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:15:00.969774 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c50f1cac-51b0-4a86-be64-6eab454c9e47 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:00.970531 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c50f1cac-51b0-4a86-be64-6eab454c9e47 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:00.977634 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c50f1cac-51b0-4a86-be64-6eab454c9e47 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:00.978362 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c50f1cac-51b0-4a86-be64-6eab454c9e47 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:00.978786 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c50f1cac-51b0-4a86-be64-6eab454c9e47 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:00.979640 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c50f1cac-51b0-4a86-be64-6eab454c9e47 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:00.980339 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c50f1cac-51b0-4a86-be64-6eab454c9e47 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:00.980907 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c50f1cac-51b0-4a86-be64-6eab454c9e47 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:01.132814 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-6fc45dbb-769b-4bf7-89c9-0cdc70c4b277 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:01.141301 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-6fc45dbb-769b-4bf7-89c9-0cdc70c4b277 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1359 microversion: 2.1 time: 0.247863 Sep 06 01:15:01.142169 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 294/564] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:00 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1359 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:01.192274 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-c50f1cac-51b0-4a86-be64-6eab454c9e47 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:01.202833 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-c50f1cac-51b0-4a86-be64-6eab454c9e47 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:01.204710 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-c50f1cac-51b0-4a86-be64-6eab454c9e47 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:01.206626 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c50f1cac-51b0-4a86-be64-6eab454c9e47 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1809 microversion: 2.20 time: 0.240681 Sep 06 01:15:01.207345 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 271/565] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:15:00 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1809 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:15:01.285578 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-203a364d-ed6b-437b-8fce-9f76d2aa4204 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:01.286199 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-203a364d-ed6b-437b-8fce-9f76d2aa4204 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:01.292246 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-203a364d-ed6b-437b-8fce-9f76d2aa4204 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:01.292986 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-203a364d-ed6b-437b-8fce-9f76d2aa4204 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:01.293422 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-203a364d-ed6b-437b-8fce-9f76d2aa4204 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:01.294119 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-203a364d-ed6b-437b-8fce-9f76d2aa4204 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:01.294572 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-203a364d-ed6b-437b-8fce-9f76d2aa4204 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:01.294996 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-203a364d-ed6b-437b-8fce-9f76d2aa4204 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:01.431917 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-203a364d-ed6b-437b-8fce-9f76d2aa4204 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:01.441542 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-203a364d-ed6b-437b-8fce-9f76d2aa4204 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1722 microversion: 2.1 time: 0.160272 Sep 06 01:15:01.442123 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 295/566] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:01 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:01.765117 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5516f085-c5c1-4628-91c7-c89ce56aa136 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:01.765784 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5516f085-c5c1-4628-91c7-c89ce56aa136 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 70d2092a-968f-45aa-a07c-ee3b6f1a918e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:01.776720 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5516f085-c5c1-4628-91c7-c89ce56aa136 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:01.778144 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5516f085-c5c1-4628-91c7-c89ce56aa136 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:01.778655 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5516f085-c5c1-4628-91c7-c89ce56aa136 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:01.779519 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5516f085-c5c1-4628-91c7-c89ce56aa136 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:01.780080 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5516f085-c5c1-4628-91c7-c89ce56aa136 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:01.780603 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5516f085-c5c1-4628-91c7-c89ce56aa136 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:01.941486 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-5516f085-c5c1-4628-91c7-c89ce56aa136 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:01.949235 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5516f085-c5c1-4628-91c7-c89ce56aa136 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e" status: 200 len: 1318 microversion: 2.1 time: 0.188067 Sep 06 01:15:01.949796 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 272/567] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:01 2022] GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:02.165588 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-8f1ad757-4c7e-4213-95f8-c3d627b6a0d2 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:02.166531 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-8f1ad757-4c7e-4213-95f8-c3d627b6a0d2 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:02.173926 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8f1ad757-4c7e-4213-95f8-c3d627b6a0d2 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:02.174423 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8f1ad757-4c7e-4213-95f8-c3d627b6a0d2 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:02.175482 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8f1ad757-4c7e-4213-95f8-c3d627b6a0d2 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:02.176218 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8f1ad757-4c7e-4213-95f8-c3d627b6a0d2 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:02.176682 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8f1ad757-4c7e-4213-95f8-c3d627b6a0d2 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:02.177097 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8f1ad757-4c7e-4213-95f8-c3d627b6a0d2 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:02.237104 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-315e2b81-e630-4a4d-b1ff-3100947dcaa4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:02.240472 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-315e2b81-e630-4a4d-b1ff-3100947dcaa4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:02.251398 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-315e2b81-e630-4a4d-b1ff-3100947dcaa4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:02.251938 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-315e2b81-e630-4a4d-b1ff-3100947dcaa4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:02.252381 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-315e2b81-e630-4a4d-b1ff-3100947dcaa4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:02.253123 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-315e2b81-e630-4a4d-b1ff-3100947dcaa4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:02.253685 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-315e2b81-e630-4a4d-b1ff-3100947dcaa4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:02.254329 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-315e2b81-e630-4a4d-b1ff-3100947dcaa4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:02.384164 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-8f1ad757-4c7e-4213-95f8-c3d627b6a0d2 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:02.392542 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-8f1ad757-4c7e-4213-95f8-c3d627b6a0d2 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1359 microversion: 2.1 time: 0.230679 Sep 06 01:15:02.408205 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 296/568] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:02 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1359 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:02.451425 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-315e2b81-e630-4a4d-b1ff-3100947dcaa4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:02.460864 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-315e2b81-e630-4a4d-b1ff-3100947dcaa4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:02.462520 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-315e2b81-e630-4a4d-b1ff-3100947dcaa4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:02.463734 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-315e2b81-e630-4a4d-b1ff-3100947dcaa4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1809 microversion: 2.20 time: 0.230669 Sep 06 01:15:02.466395 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-dcc00cba-2b78-495f-bec9-b2c5e1e5bf22 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:02.467733 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-dcc00cba-2b78-495f-bec9-b2c5e1e5bf22 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:02.475302 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dcc00cba-2b78-495f-bec9-b2c5e1e5bf22 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:02.476104 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dcc00cba-2b78-495f-bec9-b2c5e1e5bf22 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:02.476791 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dcc00cba-2b78-495f-bec9-b2c5e1e5bf22 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:02.477852 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dcc00cba-2b78-495f-bec9-b2c5e1e5bf22 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:02.478521 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dcc00cba-2b78-495f-bec9-b2c5e1e5bf22 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:02.479156 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dcc00cba-2b78-495f-bec9-b2c5e1e5bf22 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:02.480322 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 273/569] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:15:02 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1809 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:15:02.501595 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-2fda7164-9172-4f9c-b7a4-1373b22ba1d5 req-b2b82892-1a28-4dfe-8b80-a67df74964c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c42df4ca-a678-4b12-b5dc-3f3c0af93125", "name": "network-vif-plugged", "status": "completed", "tag": "9f5084ac-bd14-44b7-bba5-06b59fd5291e"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:15:02.512142 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-2fda7164-9172-4f9c-b7a4-1373b22ba1d5 req-b2b82892-1a28-4dfe-8b80-a67df74964c6 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:02.512617 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-2fda7164-9172-4f9c-b7a4-1373b22ba1d5 req-b2b82892-1a28-4dfe-8b80-a67df74964c6 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:02.513081 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-2fda7164-9172-4f9c-b7a4-1373b22ba1d5 req-b2b82892-1a28-4dfe-8b80-a67df74964c6 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:02.526118 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-2fda7164-9172-4f9c-b7a4-1373b22ba1d5 req-b2b82892-1a28-4dfe-8b80-a67df74964c6 service nova] Creating event network-vif-plugged:9f5084ac-bd14-44b7-bba5-06b59fd5291e for instance c42df4ca-a678-4b12-b5dc-3f3c0af93125 on hv-cinder-84773 Sep 06 01:15:02.531438 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-2fda7164-9172-4f9c-b7a4-1373b22ba1d5 req-b2b82892-1a28-4dfe-8b80-a67df74964c6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034781 Sep 06 01:15:02.532113 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 274/570] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 01:15:02.648428 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-dcc00cba-2b78-495f-bec9-b2c5e1e5bf22 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:02.656585 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-dcc00cba-2b78-495f-bec9-b2c5e1e5bf22 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1722 microversion: 2.1 time: 0.194553 Sep 06 01:15:02.657178 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 297/571] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:02 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:15:02.974720 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fa1bdc66-28d2-461f-a811-7dfab41516fa tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:02.975415 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fa1bdc66-28d2-461f-a811-7dfab41516fa tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 70d2092a-968f-45aa-a07c-ee3b6f1a918e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:02.982035 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa1bdc66-28d2-461f-a811-7dfab41516fa tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:02.982517 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa1bdc66-28d2-461f-a811-7dfab41516fa tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:02.982952 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa1bdc66-28d2-461f-a811-7dfab41516fa tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:02.983644 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa1bdc66-28d2-461f-a811-7dfab41516fa tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:02.984119 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa1bdc66-28d2-461f-a811-7dfab41516fa tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:02.984541 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa1bdc66-28d2-461f-a811-7dfab41516fa tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:03.132342 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-fa1bdc66-28d2-461f-a811-7dfab41516fa tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:03.139966 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fa1bdc66-28d2-461f-a811-7dfab41516fa tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e" status: 200 len: 1318 microversion: 2.1 time: 0.170518 Sep 06 01:15:03.140713 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 275/572] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:02 2022] GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:03.420603 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-feea752f-68ac-4c3f-b571-fb269aa75895 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:03.421218 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-feea752f-68ac-4c3f-b571-fb269aa75895 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:03.428443 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-feea752f-68ac-4c3f-b571-fb269aa75895 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:03.428930 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-feea752f-68ac-4c3f-b571-fb269aa75895 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:03.429367 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-feea752f-68ac-4c3f-b571-fb269aa75895 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:03.430073 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-feea752f-68ac-4c3f-b571-fb269aa75895 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:03.430527 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-feea752f-68ac-4c3f-b571-fb269aa75895 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:03.430952 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-feea752f-68ac-4c3f-b571-fb269aa75895 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:03.490859 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-66d313d3-ffe8-42fa-a2b5-3901d8efcfc1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:03.491511 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-66d313d3-ffe8-42fa-a2b5-3901d8efcfc1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:03.497905 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-66d313d3-ffe8-42fa-a2b5-3901d8efcfc1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:03.498396 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-66d313d3-ffe8-42fa-a2b5-3901d8efcfc1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:03.498833 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-66d313d3-ffe8-42fa-a2b5-3901d8efcfc1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:03.499533 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-66d313d3-ffe8-42fa-a2b5-3901d8efcfc1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:03.500009 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-66d313d3-ffe8-42fa-a2b5-3901d8efcfc1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:03.500572 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-66d313d3-ffe8-42fa-a2b5-3901d8efcfc1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:03.645855 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-feea752f-68ac-4c3f-b571-fb269aa75895 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:03.658780 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-feea752f-68ac-4c3f-b571-fb269aa75895 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1359 microversion: 2.1 time: 0.242395 Sep 06 01:15:03.660241 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 298/573] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:03 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1359 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:03.681810 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-4e692dce-3d79-4f19-92cd-500b7efc25f7 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:03.682727 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-4e692dce-3d79-4f19-92cd-500b7efc25f7 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:03.689314 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4e692dce-3d79-4f19-92cd-500b7efc25f7 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:03.690285 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4e692dce-3d79-4f19-92cd-500b7efc25f7 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:03.691032 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4e692dce-3d79-4f19-92cd-500b7efc25f7 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:03.693254 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4e692dce-3d79-4f19-92cd-500b7efc25f7 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:03.694242 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4e692dce-3d79-4f19-92cd-500b7efc25f7 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:03.696734 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-66d313d3-ffe8-42fa-a2b5-3901d8efcfc1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:03.699434 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4e692dce-3d79-4f19-92cd-500b7efc25f7 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:03.706162 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-66d313d3-ffe8-42fa-a2b5-3901d8efcfc1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:03.708276 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-66d313d3-ffe8-42fa-a2b5-3901d8efcfc1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:03.709513 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-66d313d3-ffe8-42fa-a2b5-3901d8efcfc1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1809 microversion: 2.20 time: 0.223226 Sep 06 01:15:03.710582 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 276/574] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:15:03 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1809 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:15:03.868164 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-4e692dce-3d79-4f19-92cd-500b7efc25f7 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:03.878197 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-4e692dce-3d79-4f19-92cd-500b7efc25f7 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1722 microversion: 2.1 time: 0.200166 Sep 06 01:15:03.879522 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 299/575] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:03 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:15:04.175082 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8843ea4b-0199-46ba-bc2b-303209a884db tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:04.177092 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8843ea4b-0199-46ba-bc2b-303209a884db tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 70d2092a-968f-45aa-a07c-ee3b6f1a918e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:04.197588 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8843ea4b-0199-46ba-bc2b-303209a884db tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:04.198431 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8843ea4b-0199-46ba-bc2b-303209a884db tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:04.199211 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8843ea4b-0199-46ba-bc2b-303209a884db tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:04.203651 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8843ea4b-0199-46ba-bc2b-303209a884db tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:04.204218 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8843ea4b-0199-46ba-bc2b-303209a884db tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:04.204764 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8843ea4b-0199-46ba-bc2b-303209a884db tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:04.346251 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-8843ea4b-0199-46ba-bc2b-303209a884db tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:04.354925 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8843ea4b-0199-46ba-bc2b-303209a884db tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e" status: 200 len: 1318 microversion: 2.1 time: 0.189829 Sep 06 01:15:04.355499 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 277/576] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:04 2022] GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:04.684512 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-15ac7733-9b0f-460b-983b-e77720b9733b tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:04.685243 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-15ac7733-9b0f-460b-983b-e77720b9733b tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:04.692623 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-15ac7733-9b0f-460b-983b-e77720b9733b tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:04.693103 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-15ac7733-9b0f-460b-983b-e77720b9733b tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:04.693533 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-15ac7733-9b0f-460b-983b-e77720b9733b tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:04.694221 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-15ac7733-9b0f-460b-983b-e77720b9733b tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:04.694669 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-15ac7733-9b0f-460b-983b-e77720b9733b tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:04.695083 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-15ac7733-9b0f-460b-983b-e77720b9733b tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:04.740151 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-86678dc5-8aa6-4ffe-af97-8cc4e3783c13 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:04.740833 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-86678dc5-8aa6-4ffe-af97-8cc4e3783c13 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:04.743925 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:15:04.751948 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:15:04.758027 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86678dc5-8aa6-4ffe-af97-8cc4e3783c13 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:04.758522 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86678dc5-8aa6-4ffe-af97-8cc4e3783c13 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:04.758956 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86678dc5-8aa6-4ffe-af97-8cc4e3783c13 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:04.759667 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86678dc5-8aa6-4ffe-af97-8cc4e3783c13 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:04.760186 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86678dc5-8aa6-4ffe-af97-8cc4e3783c13 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:04.760608 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86678dc5-8aa6-4ffe-af97-8cc4e3783c13 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:04.901848 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-15ac7733-9b0f-460b-983b-e77720b9733b tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:04.911314 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-15ac7733-9b0f-460b-983b-e77720b9733b tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1359 microversion: 2.1 time: 0.230481 Sep 06 01:15:04.911314 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 300/577] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:04 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1359 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:04.920898 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-20e305c3-bd60-4636-97c5-30a1d07193c0 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:04.921722 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-20e305c3-bd60-4636-97c5-30a1d07193c0 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:04.932348 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-20e305c3-bd60-4636-97c5-30a1d07193c0 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:04.932836 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-20e305c3-bd60-4636-97c5-30a1d07193c0 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:04.933267 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-20e305c3-bd60-4636-97c5-30a1d07193c0 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:04.933970 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-20e305c3-bd60-4636-97c5-30a1d07193c0 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:04.934420 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-20e305c3-bd60-4636-97c5-30a1d07193c0 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:04.934840 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-20e305c3-bd60-4636-97c5-30a1d07193c0 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:04.935278 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell0:SELECT=6 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:15:04.957442 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-86678dc5-8aa6-4ffe-af97-8cc4e3783c13 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:04.966465 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-86678dc5-8aa6-4ffe-af97-8cc4e3783c13 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:04.967954 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-86678dc5-8aa6-4ffe-af97-8cc4e3783c13 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:04.969138 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-86678dc5-8aa6-4ffe-af97-8cc4e3783c13 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1809 microversion: 2.20 time: 0.232981 Sep 06 01:15:04.970027 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 278/578] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:15:04 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1809 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:15:05.076176 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-20e305c3-bd60-4636-97c5-30a1d07193c0 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:05.084591 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-20e305c3-bd60-4636-97c5-30a1d07193c0 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1722 microversion: 2.1 time: 0.172253 Sep 06 01:15:05.085276 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 301/579] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:04 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:05.377107 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0c764fbe-41ba-42d3-9fa8-f18dd729835a tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:05.377731 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0c764fbe-41ba-42d3-9fa8-f18dd729835a tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 70d2092a-968f-45aa-a07c-ee3b6f1a918e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:05.384547 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c764fbe-41ba-42d3-9fa8-f18dd729835a tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:05.385193 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c764fbe-41ba-42d3-9fa8-f18dd729835a tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:05.385692 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c764fbe-41ba-42d3-9fa8-f18dd729835a tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:05.386448 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c764fbe-41ba-42d3-9fa8-f18dd729835a tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:05.387088 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c764fbe-41ba-42d3-9fa8-f18dd729835a tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:05.387591 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c764fbe-41ba-42d3-9fa8-f18dd729835a tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:05.527634 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-0c764fbe-41ba-42d3-9fa8-f18dd729835a tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:05.536072 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0c764fbe-41ba-42d3-9fa8-f18dd729835a tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e" status: 200 len: 1318 microversion: 2.1 time: 0.162812 Sep 06 01:15:05.536661 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 279/580] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:05 2022] GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:05.935176 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-9f5e86b1-0b1d-4467-beee-c54b971febe9 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:05.935871 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-9f5e86b1-0b1d-4467-beee-c54b971febe9 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:05.943273 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9f5e86b1-0b1d-4467-beee-c54b971febe9 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:05.943774 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9f5e86b1-0b1d-4467-beee-c54b971febe9 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:05.944203 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9f5e86b1-0b1d-4467-beee-c54b971febe9 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:05.944892 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9f5e86b1-0b1d-4467-beee-c54b971febe9 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:05.945356 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9f5e86b1-0b1d-4467-beee-c54b971febe9 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:05.945950 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9f5e86b1-0b1d-4467-beee-c54b971febe9 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:05.998510 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2bbb0f21-31d5-458c-a451-3403167eb533 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:05.999021 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2bbb0f21-31d5-458c-a451-3403167eb533 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:06.005820 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2bbb0f21-31d5-458c-a451-3403167eb533 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:06.006300 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2bbb0f21-31d5-458c-a451-3403167eb533 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:06.006727 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2bbb0f21-31d5-458c-a451-3403167eb533 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:06.007492 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2bbb0f21-31d5-458c-a451-3403167eb533 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:06.007988 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2bbb0f21-31d5-458c-a451-3403167eb533 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:06.008535 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2bbb0f21-31d5-458c-a451-3403167eb533 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:06.125504 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-9f5e86b1-0b1d-4467-beee-c54b971febe9 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:06.141622 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-9f5e86b1-0b1d-4467-beee-c54b971febe9 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1359 microversion: 2.1 time: 0.210398 Sep 06 01:15:06.142376 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 302/581] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:05 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1359 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:06.147492 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-d82b4d8d-34d9-45b2-a0dc-48a5b9dc8aae tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:06.147988 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-d82b4d8d-34d9-45b2-a0dc-48a5b9dc8aae tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:06.164355 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d82b4d8d-34d9-45b2-a0dc-48a5b9dc8aae tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:06.164854 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d82b4d8d-34d9-45b2-a0dc-48a5b9dc8aae tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:06.165290 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d82b4d8d-34d9-45b2-a0dc-48a5b9dc8aae tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:06.166081 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d82b4d8d-34d9-45b2-a0dc-48a5b9dc8aae tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:06.166529 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d82b4d8d-34d9-45b2-a0dc-48a5b9dc8aae tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:06.166967 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d82b4d8d-34d9-45b2-a0dc-48a5b9dc8aae tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:06.178726 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-2bbb0f21-31d5-458c-a451-3403167eb533 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:06.188183 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-2bbb0f21-31d5-458c-a451-3403167eb533 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:06.189652 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-2bbb0f21-31d5-458c-a451-3403167eb533 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:06.191851 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2bbb0f21-31d5-458c-a451-3403167eb533 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1809 microversion: 2.20 time: 0.197229 Sep 06 01:15:06.195744 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 280/582] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:15:05 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1809 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:15:06.308872 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-d82b4d8d-34d9-45b2-a0dc-48a5b9dc8aae tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:06.318155 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-d82b4d8d-34d9-45b2-a0dc-48a5b9dc8aae tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1722 microversion: 2.1 time: 0.174932 Sep 06 01:15:06.318721 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 303/583] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:06 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:06.560410 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-337e15ad-3061-49d1-9eaf-535a62ae9ccb tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:06.560949 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-337e15ad-3061-49d1-9eaf-535a62ae9ccb tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 70d2092a-968f-45aa-a07c-ee3b6f1a918e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:06.568141 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-337e15ad-3061-49d1-9eaf-535a62ae9ccb tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:06.568720 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-337e15ad-3061-49d1-9eaf-535a62ae9ccb tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:06.569318 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-337e15ad-3061-49d1-9eaf-535a62ae9ccb tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:06.570082 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-337e15ad-3061-49d1-9eaf-535a62ae9ccb tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:06.570675 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-337e15ad-3061-49d1-9eaf-535a62ae9ccb tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:06.571232 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-337e15ad-3061-49d1-9eaf-535a62ae9ccb tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:06.720402 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-337e15ad-3061-49d1-9eaf-535a62ae9ccb tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:06.728703 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-337e15ad-3061-49d1-9eaf-535a62ae9ccb tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e" status: 200 len: 1318 microversion: 2.1 time: 0.172223 Sep 06 01:15:06.729265 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 281/584] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:06 2022] GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:07.165920 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-a2b2f2c7-8280-425f-b93b-35d627fe85cf tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:07.166491 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-a2b2f2c7-8280-425f-b93b-35d627fe85cf tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:07.173183 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a2b2f2c7-8280-425f-b93b-35d627fe85cf tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:07.173663 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a2b2f2c7-8280-425f-b93b-35d627fe85cf tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:07.174097 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a2b2f2c7-8280-425f-b93b-35d627fe85cf tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:07.175274 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a2b2f2c7-8280-425f-b93b-35d627fe85cf tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:07.175725 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a2b2f2c7-8280-425f-b93b-35d627fe85cf tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:07.176172 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a2b2f2c7-8280-425f-b93b-35d627fe85cf tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:07.217401 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ff33c83f-91ca-4002-a64e-d4dc674bf5ca tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:07.217998 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ff33c83f-91ca-4002-a64e-d4dc674bf5ca tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:07.223863 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ff33c83f-91ca-4002-a64e-d4dc674bf5ca tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:07.224357 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ff33c83f-91ca-4002-a64e-d4dc674bf5ca tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:07.224854 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ff33c83f-91ca-4002-a64e-d4dc674bf5ca tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:07.225560 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ff33c83f-91ca-4002-a64e-d4dc674bf5ca tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:07.226016 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ff33c83f-91ca-4002-a64e-d4dc674bf5ca tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:07.226444 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ff33c83f-91ca-4002-a64e-d4dc674bf5ca tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:07.360373 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-a2b2f2c7-8280-425f-b93b-35d627fe85cf tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:07.368412 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-a2b2f2c7-8280-425f-b93b-35d627fe85cf tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1359 microversion: 2.1 time: 0.206384 Sep 06 01:15:07.368979 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 304/585] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:07 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1359 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:07.373412 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-af75fd5f-8cf6-4703-8d46-5e77fb1d3211 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:07.374048 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-af75fd5f-8cf6-4703-8d46-5e77fb1d3211 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:07.380696 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-af75fd5f-8cf6-4703-8d46-5e77fb1d3211 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:07.381316 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-af75fd5f-8cf6-4703-8d46-5e77fb1d3211 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:07.381752 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-af75fd5f-8cf6-4703-8d46-5e77fb1d3211 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:07.383021 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-af75fd5f-8cf6-4703-8d46-5e77fb1d3211 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:07.383474 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-af75fd5f-8cf6-4703-8d46-5e77fb1d3211 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:07.383929 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-af75fd5f-8cf6-4703-8d46-5e77fb1d3211 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:07.392744 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-ff33c83f-91ca-4002-a64e-d4dc674bf5ca tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:07.401426 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-ff33c83f-91ca-4002-a64e-d4dc674bf5ca tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:07.402978 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-ff33c83f-91ca-4002-a64e-d4dc674bf5ca tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:07.404263 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ff33c83f-91ca-4002-a64e-d4dc674bf5ca tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1809 microversion: 2.20 time: 0.190834 Sep 06 01:15:07.404899 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 282/586] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:15:07 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:15:07.509073 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-af75fd5f-8cf6-4703-8d46-5e77fb1d3211 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:07.521409 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-af75fd5f-8cf6-4703-8d46-5e77fb1d3211 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1722 microversion: 2.1 time: 0.151026 Sep 06 01:15:07.522410 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 305/587] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:07 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:07.752260 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2b8fb920-cb4c-4d57-8daa-12f5f950b0dd tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:07.752825 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2b8fb920-cb4c-4d57-8daa-12f5f950b0dd tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 70d2092a-968f-45aa-a07c-ee3b6f1a918e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:07.759213 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2b8fb920-cb4c-4d57-8daa-12f5f950b0dd tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:07.759698 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2b8fb920-cb4c-4d57-8daa-12f5f950b0dd tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:07.760168 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2b8fb920-cb4c-4d57-8daa-12f5f950b0dd tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:07.760861 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2b8fb920-cb4c-4d57-8daa-12f5f950b0dd tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:07.761317 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2b8fb920-cb4c-4d57-8daa-12f5f950b0dd tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:07.761744 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2b8fb920-cb4c-4d57-8daa-12f5f950b0dd tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:07.894452 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-2b8fb920-cb4c-4d57-8daa-12f5f950b0dd tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:07.902306 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2b8fb920-cb4c-4d57-8daa-12f5f950b0dd tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e" status: 200 len: 1318 microversion: 2.1 time: 0.154045 Sep 06 01:15:07.902860 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 283/588] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:07 2022] GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:08.392934 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-dc71603d-c196-4249-bf0b-a36f8f13c786 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:08.394341 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-dc71603d-c196-4249-bf0b-a36f8f13c786 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:08.404691 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dc71603d-c196-4249-bf0b-a36f8f13c786 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:08.405184 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dc71603d-c196-4249-bf0b-a36f8f13c786 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:08.405608 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dc71603d-c196-4249-bf0b-a36f8f13c786 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:08.412716 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dc71603d-c196-4249-bf0b-a36f8f13c786 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:08.413193 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dc71603d-c196-4249-bf0b-a36f8f13c786 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:08.413800 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dc71603d-c196-4249-bf0b-a36f8f13c786 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:08.431035 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a7b1e956-e11f-4a7f-88d0-9eadfab5f928 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:08.431848 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a7b1e956-e11f-4a7f-88d0-9eadfab5f928 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:08.438794 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a7b1e956-e11f-4a7f-88d0-9eadfab5f928 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:08.439389 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a7b1e956-e11f-4a7f-88d0-9eadfab5f928 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:08.439929 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a7b1e956-e11f-4a7f-88d0-9eadfab5f928 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:08.441194 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a7b1e956-e11f-4a7f-88d0-9eadfab5f928 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:08.441736 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a7b1e956-e11f-4a7f-88d0-9eadfab5f928 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:08.442232 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a7b1e956-e11f-4a7f-88d0-9eadfab5f928 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:08.634612 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-dc71603d-c196-4249-bf0b-a36f8f13c786 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:08.649269 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-dc71603d-c196-4249-bf0b-a36f8f13c786 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1359 microversion: 2.1 time: 0.259271 Sep 06 01:15:08.651526 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-a7b1e956-e11f-4a7f-88d0-9eadfab5f928 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:08.652012 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 306/589] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:08 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1359 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:08.664121 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-beefc2e2-01fd-4796-af98-8bda48794cd2 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:08.666499 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-beefc2e2-01fd-4796-af98-8bda48794cd2 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:08.677149 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-a7b1e956-e11f-4a7f-88d0-9eadfab5f928 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:08.680877 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-beefc2e2-01fd-4796-af98-8bda48794cd2 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:08.681056 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-a7b1e956-e11f-4a7f-88d0-9eadfab5f928 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:08.681535 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-beefc2e2-01fd-4796-af98-8bda48794cd2 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:08.682049 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-beefc2e2-01fd-4796-af98-8bda48794cd2 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:08.682837 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-beefc2e2-01fd-4796-af98-8bda48794cd2 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:08.683103 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a7b1e956-e11f-4a7f-88d0-9eadfab5f928 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1809 microversion: 2.20 time: 0.256456 Sep 06 01:15:08.683440 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-beefc2e2-01fd-4796-af98-8bda48794cd2 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:08.695780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 284/590] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:15:08 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1809 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:15:08.696248 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-beefc2e2-01fd-4796-af98-8bda48794cd2 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:08.696349 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ecc3687c-2c24-49b5-b41e-dcbed7181fbd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:08.696349 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ecc3687c-2c24-49b5-b41e-dcbed7181fbd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:08.698035 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ecc3687c-2c24-49b5-b41e-dcbed7181fbd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:08.698738 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ecc3687c-2c24-49b5-b41e-dcbed7181fbd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:08.699528 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ecc3687c-2c24-49b5-b41e-dcbed7181fbd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:08.700453 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ecc3687c-2c24-49b5-b41e-dcbed7181fbd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:08.701144 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ecc3687c-2c24-49b5-b41e-dcbed7181fbd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:08.701784 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ecc3687c-2c24-49b5-b41e-dcbed7181fbd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:08.727311 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ecc3687c-2c24-49b5-b41e-dcbed7181fbd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5/ips" status: 200 len: 150 microversion: 2.1 time: 0.041731 Sep 06 01:15:08.730457 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 285/591] 10.222.0.23 () {58 vars in 1248 bytes} [Tue Sep 6 01:15:08 2022] GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:15:08.741510 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d55fb39b-2aea-4164-b462-0a21d67b54b0 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ac6fa67-d970-433d-be24-0bc4bed540dc"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:15:08.744299 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d55fb39b-2aea-4164-b462-0a21d67b54b0 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:08.750253 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d55fb39b-2aea-4164-b462-0a21d67b54b0 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:08.750734 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d55fb39b-2aea-4164-b462-0a21d67b54b0 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:08.751167 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d55fb39b-2aea-4164-b462-0a21d67b54b0 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:08.751905 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d55fb39b-2aea-4164-b462-0a21d67b54b0 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:08.752359 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d55fb39b-2aea-4164-b462-0a21d67b54b0 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:08.753572 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d55fb39b-2aea-4164-b462-0a21d67b54b0 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:08.835989 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-beefc2e2-01fd-4796-af98-8bda48794cd2 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:08.836257 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-d55fb39b-2aea-4164-b462-0a21d67b54b0 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] HTTP exception thrown: Invalid volume: volume 8ac6fa67-d970-433d-be24-0bc4bed540dc is already attached to instances: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e Sep 06 01:15:08.838052 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d55fb39b-2aea-4164-b462-0a21d67b54b0 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Request method failure captured: Sep 06 01:15:08.838052 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: request: POST /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5/os-volume_attachments HTTP/1.1 Sep 06 01:15:08.838052 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept: application/json Sep 06 01:15:08.838052 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept-Encoding: identity Sep 06 01:15:08.838052 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Connection: close Sep 06 01:15:08.838052 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Length: 74 Sep 06 01:15:08.838052 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Type: application/json Sep 06 01:15:08.838052 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Host: 10.222.0.23 Sep 06 01:15:08.838052 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Openstack-System-Scope: None Sep 06 01:15:08.838052 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Sep 06 01:15:08.838052 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjFp5HgEJZI7pOCAbhWXwWFE8yQ5t7K_Ws-jshDHbF7sXnYLPl16IIONgrpvYxWiZSDSAeitprugb5h17_eYSiBNUfLgmC9hbcnAOoP7NTvslLSb0CTURVLZpiFrwKL1VvcCbnqL_bQbP7LRSB17fvFEoXQ1dcjQQQPX7LNrOn0pG4F5A Sep 06 01:15:08.838052 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Id: None Sep 06 01:15:08.838052 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Name: None Sep 06 01:15:08.838052 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Identity-Status: Confirmed Sep 06 01:15:08.838052 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Is-Admin-Project: True Sep 06 01:15:08.838052 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Id: default Sep 06 01:15:08.838052 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Name: Default Sep 06 01:15:08.838052 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Id: 1fa73b0bfee14a9ea25f03e523078995 Sep 06 01:15:08.838052 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Name: tempest-AttachVolumeNegativeTest-1412452604 Sep 06 01:15:08.838052 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Role: reader,member Sep 06 01:15:08.838052 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Roles: reader,member Sep 06 01:15:08.839644 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1fa73b0bfee14a9ea25f03e523078995"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1fa73b0bfee14a9ea25f03e523078995"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1fa73b0bfee14a9ea25f03e523078995"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1fa73b0bfee14a9ea25f03e523078995"}]}] Sep 06 01:15:08.839644 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant: tempest-AttachVolumeNegativeTest-1412452604 Sep 06 01:15:08.839644 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Id: 1fa73b0bfee14a9ea25f03e523078995 Sep 06 01:15:08.839644 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1412452604 Sep 06 01:15:08.839644 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User: tempest-AttachVolumeNegativeTest-1412452604-project Sep 06 01:15:08.839644 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Id: default Sep 06 01:15:08.839644 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Name: Default Sep 06 01:15:08.839644 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Id: f8f44df824414e5ebc8cfd2126e9d66f Sep 06 01:15:08.839644 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Name: tempest-AttachVolumeNegativeTest-1412452604-project Sep 06 01:15:08.839644 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Sep 06 01:15:08.839644 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: {"volumeAttachment": {"volumeId": "8ac6fa67-d970-433d-be24-0bc4bed540dc"}} Sep 06 01:15:08.839644 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: method: > Sep 06 01:15:08.840666 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: exception: Invalid volume: volume 8ac6fa67-d970-433d-be24-0bc4bed540dc is already attached to instances: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e Sep 06 01:15:08.840666 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: action_args: {'server_id': 'f9a2a405-dce3-4320-b44d-a19c556501b5', 'body': {'volumeAttachment': {'volumeId': '8ac6fa67-d970-433d-be24-0bc4bed540dc'}}} Sep 06 01:15:08.840666 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:15:08.840666 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:15:08.840666 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 06 01:15:08.840666 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 06 01:15:08.840666 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 01:15:08.840666 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 01:15:08.840666 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 06 01:15:08.840666 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 06 01:15:08.840666 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 06 01:15:08.840666 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 06 01:15:08.840666 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 06 01:15:08.840666 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 06 01:15:08.840666 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8ac6fa67-d970-433d-be24-0bc4bed540dc is already attached to instances: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e Sep 06 01:15:08.840666 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:15:08.840666 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:15:08.840666 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:15:08.840666 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:15:08.842208 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:15:08.842208 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:15:08.842208 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:15:08.842208 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:15:08.842208 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:15:08.842208 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:15:08.842208 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 01:15:08.842208 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 01:15:08.842208 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 01:15:08.842208 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 01:15:08.842208 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 01:15:08.842208 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 01:15:08.842208 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 06 01:15:08.842208 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 06 01:15:08.842208 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8ac6fa67-d970-433d-be24-0bc4bed540dc is already attached to instances: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e Sep 06 01:15:08.842208 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:15:08.842208 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:15:08.842208 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:15:08.842208 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:15:08.842208 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:15:08.843690 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:15:08.843690 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:15:08.843690 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:15:08.843690 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8ac6fa67-d970-433d-be24-0bc4bed540dc is already attached to instances: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e Sep 06 01:15:08.843690 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:15:08.843690 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d55fb39b-2aea-4164-b462-0a21d67b54b0 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Returning 400 to user: Invalid volume: volume 8ac6fa67-d970-433d-be24-0bc4bed540dc is already attached to instances: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:15:08.843690 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d55fb39b-2aea-4164-b462-0a21d67b54b0 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "POST /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102614 Sep 06 01:15:08.843690 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 286/592] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Sep 6 01:15:08 2022] POST /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 01:15:08.848161 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-beefc2e2-01fd-4796-af98-8bda48794cd2 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1722 microversion: 2.1 time: 0.194913 Sep 06 01:15:08.848362 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9a6ae8b8-2319-42b1-8958-656fe9a0c295 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:08.848718 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 307/593] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:08 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:08.848826 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9a6ae8b8-2319-42b1-8958-656fe9a0c295 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:08.857064 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9a6ae8b8-2319-42b1-8958-656fe9a0c295 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:08.857543 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9a6ae8b8-2319-42b1-8958-656fe9a0c295 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:08.857976 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9a6ae8b8-2319-42b1-8958-656fe9a0c295 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:08.858665 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9a6ae8b8-2319-42b1-8958-656fe9a0c295 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:08.859115 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9a6ae8b8-2319-42b1-8958-656fe9a0c295 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:08.859535 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9a6ae8b8-2319-42b1-8958-656fe9a0c295 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:08.863990 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:15:08.885461 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9a6ae8b8-2319-42b1-8958-656fe9a0c295 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 01:15:08.936402 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-defa6288-1f99-4900-ba69-f9ded9d38dc6 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:08.937015 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-defa6288-1f99-4900-ba69-f9ded9d38dc6 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 70d2092a-968f-45aa-a07c-ee3b6f1a918e] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:08.943089 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-defa6288-1f99-4900-ba69-f9ded9d38dc6 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:08.943569 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-defa6288-1f99-4900-ba69-f9ded9d38dc6 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:08.944036 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-defa6288-1f99-4900-ba69-f9ded9d38dc6 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:08.944721 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-defa6288-1f99-4900-ba69-f9ded9d38dc6 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:08.945173 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-defa6288-1f99-4900-ba69-f9ded9d38dc6 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:08.945659 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-defa6288-1f99-4900-ba69-f9ded9d38dc6 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:08.961367 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9a6ae8b8-2319-42b1-8958-656fe9a0c295 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5" status: 204 len: 0 microversion: 2.1 time: 0.116407 Sep 06 01:15:08.961945 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 287/594] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 6 01:15:08 2022] DELETE /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 01:15:08.970268 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bedfb870-7a3e-40e4-8216-a2f7e5392f39 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:08.970957 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bedfb870-7a3e-40e4-8216-a2f7e5392f39 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:08.977071 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bedfb870-7a3e-40e4-8216-a2f7e5392f39 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:08.977545 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bedfb870-7a3e-40e4-8216-a2f7e5392f39 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:08.977974 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bedfb870-7a3e-40e4-8216-a2f7e5392f39 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:08.978647 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bedfb870-7a3e-40e4-8216-a2f7e5392f39 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:08.979096 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bedfb870-7a3e-40e4-8216-a2f7e5392f39 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:08.979511 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bedfb870-7a3e-40e4-8216-a2f7e5392f39 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:09.146428 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-defa6288-1f99-4900-ba69-f9ded9d38dc6 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:09.156392 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-defa6288-1f99-4900-ba69-f9ded9d38dc6 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e" status: 200 len: 1318 microversion: 2.1 time: 0.234057 Sep 06 01:15:09.159335 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 308/595] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:08 2022] GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:15:09.170851 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-bedfb870-7a3e-40e4-8216-a2f7e5392f39 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:09.179251 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bedfb870-7a3e-40e4-8216-a2f7e5392f39 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5" status: 200 len: 1683 microversion: 2.1 time: 0.212980 Sep 06 01:15:09.179919 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 288/596] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:08 2022] GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5 => generated 1683 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:15:09.674626 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-9f9df7e8-6013-4c12-b20d-6614dba85ae9 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:09.675260 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-9f9df7e8-6013-4c12-b20d-6614dba85ae9 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:09.681628 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9f9df7e8-6013-4c12-b20d-6614dba85ae9 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:09.682101 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9f9df7e8-6013-4c12-b20d-6614dba85ae9 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:09.682532 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9f9df7e8-6013-4c12-b20d-6614dba85ae9 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:09.683205 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9f9df7e8-6013-4c12-b20d-6614dba85ae9 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:09.683651 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9f9df7e8-6013-4c12-b20d-6614dba85ae9 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:09.684091 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9f9df7e8-6013-4c12-b20d-6614dba85ae9 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:09.714288 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4417a9ea-3190-49e9-b123-048008d6ff64 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:09.714897 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4417a9ea-3190-49e9-b123-048008d6ff64 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:09.720881 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4417a9ea-3190-49e9-b123-048008d6ff64 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:09.721380 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4417a9ea-3190-49e9-b123-048008d6ff64 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:09.721806 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4417a9ea-3190-49e9-b123-048008d6ff64 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:09.722501 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4417a9ea-3190-49e9-b123-048008d6ff64 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:09.722957 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4417a9ea-3190-49e9-b123-048008d6ff64 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:09.723385 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4417a9ea-3190-49e9-b123-048008d6ff64 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:09.860078 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-9f9df7e8-6013-4c12-b20d-6614dba85ae9 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:09.867868 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-9f9df7e8-6013-4c12-b20d-6614dba85ae9 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1359 microversion: 2.1 time: 0.197090 Sep 06 01:15:09.868473 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 309/597] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:09 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1359 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:09.872902 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-093f7f12-39e3-408b-b52b-c4c4f1ec6a00 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:09.873504 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-093f7f12-39e3-408b-b52b-c4c4f1ec6a00 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:09.879786 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-093f7f12-39e3-408b-b52b-c4c4f1ec6a00 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:09.880285 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-093f7f12-39e3-408b-b52b-c4c4f1ec6a00 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:09.880721 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-093f7f12-39e3-408b-b52b-c4c4f1ec6a00 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:09.881481 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-093f7f12-39e3-408b-b52b-c4c4f1ec6a00 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:09.881941 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-093f7f12-39e3-408b-b52b-c4c4f1ec6a00 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:09.882372 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-093f7f12-39e3-408b-b52b-c4c4f1ec6a00 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:09.886985 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-4417a9ea-3190-49e9-b123-048008d6ff64 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:09.897051 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-4417a9ea-3190-49e9-b123-048008d6ff64 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:09.898492 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-4417a9ea-3190-49e9-b123-048008d6ff64 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:09.899786 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4417a9ea-3190-49e9-b123-048008d6ff64 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1809 microversion: 2.20 time: 0.189230 Sep 06 01:15:09.900435 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 289/598] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:15:09 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1809 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:15:10.015000 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-093f7f12-39e3-408b-b52b-c4c4f1ec6a00 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:10.018973 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell1:SELECT=100 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:15:10.025282 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-093f7f12-39e3-408b-b52b-c4c4f1ec6a00 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1722 microversion: 2.1 time: 0.155539 Sep 06 01:15:10.026191 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 310/599] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:09 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:10.180239 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-97fe9ea7-bc12-47c3-8542-f138f28c835f tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:10.180842 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-97fe9ea7-bc12-47c3-8542-f138f28c835f tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 70d2092a-968f-45aa-a07c-ee3b6f1a918e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:10.186750 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97fe9ea7-bc12-47c3-8542-f138f28c835f tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:10.187208 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97fe9ea7-bc12-47c3-8542-f138f28c835f tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:10.187636 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97fe9ea7-bc12-47c3-8542-f138f28c835f tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:10.188462 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97fe9ea7-bc12-47c3-8542-f138f28c835f tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:10.188908 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97fe9ea7-bc12-47c3-8542-f138f28c835f tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:10.189322 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97fe9ea7-bc12-47c3-8542-f138f28c835f tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:10.202589 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-c43c7fb1-c4c2-4393-b181-225efc3034d2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:10.203207 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-c43c7fb1-c4c2-4393-b181-225efc3034d2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:10.209193 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c43c7fb1-c4c2-4393-b181-225efc3034d2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:10.209674 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c43c7fb1-c4c2-4393-b181-225efc3034d2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:10.210108 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c43c7fb1-c4c2-4393-b181-225efc3034d2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:10.210800 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c43c7fb1-c4c2-4393-b181-225efc3034d2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:10.211255 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c43c7fb1-c4c2-4393-b181-225efc3034d2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:10.211677 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c43c7fb1-c4c2-4393-b181-225efc3034d2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:10.377487 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-97fe9ea7-bc12-47c3-8542-f138f28c835f tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:10.385546 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-97fe9ea7-bc12-47c3-8542-f138f28c835f tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e" status: 200 len: 1318 microversion: 2.1 time: 0.209403 Sep 06 01:15:10.386111 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 290/600] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:10 2022] GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:10.395408 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-c43c7fb1-c4c2-4393-b181-225efc3034d2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:10.403263 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-c43c7fb1-c4c2-4393-b181-225efc3034d2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5" status: 200 len: 1683 microversion: 2.1 time: 0.204851 Sep 06 01:15:10.403848 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 311/601] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:10 2022] GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5 => generated 1683 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:15:10.891396 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-daf5a92b-3070-4b30-9762-9351cc09297f tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:10.892439 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-daf5a92b-3070-4b30-9762-9351cc09297f tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:10.898897 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-daf5a92b-3070-4b30-9762-9351cc09297f tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:10.899408 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-daf5a92b-3070-4b30-9762-9351cc09297f tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:10.899884 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-daf5a92b-3070-4b30-9762-9351cc09297f tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:10.900587 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-daf5a92b-3070-4b30-9762-9351cc09297f tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:10.901039 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-daf5a92b-3070-4b30-9762-9351cc09297f tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:10.901461 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-daf5a92b-3070-4b30-9762-9351cc09297f tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:10.926151 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-ce6de04b-e835-4a56-87b1-449929131db8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:10.926759 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-ce6de04b-e835-4a56-87b1-449929131db8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:10.929039 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:15:10.934267 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ce6de04b-e835-4a56-87b1-449929131db8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:10.934744 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ce6de04b-e835-4a56-87b1-449929131db8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:10.935178 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ce6de04b-e835-4a56-87b1-449929131db8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:10.935889 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ce6de04b-e835-4a56-87b1-449929131db8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:10.936338 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ce6de04b-e835-4a56-87b1-449929131db8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:10.936758 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ce6de04b-e835-4a56-87b1-449929131db8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:11.081508 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-daf5a92b-3070-4b30-9762-9351cc09297f tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:11.089128 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-daf5a92b-3070-4b30-9762-9351cc09297f tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1359 microversion: 2.1 time: 0.201611 Sep 06 01:15:11.089700 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 291/602] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:10 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1359 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:11.094428 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-38fd4f53-84cd-4af2-b316-e435e2e6e4c0 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:11.095126 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-38fd4f53-84cd-4af2-b316-e435e2e6e4c0 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:11.101115 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38fd4f53-84cd-4af2-b316-e435e2e6e4c0 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:11.101537 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38fd4f53-84cd-4af2-b316-e435e2e6e4c0 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:11.102143 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38fd4f53-84cd-4af2-b316-e435e2e6e4c0 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:11.102673 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38fd4f53-84cd-4af2-b316-e435e2e6e4c0 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:11.103187 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38fd4f53-84cd-4af2-b316-e435e2e6e4c0 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:11.103533 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38fd4f53-84cd-4af2-b316-e435e2e6e4c0 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:11.109406 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-ce6de04b-e835-4a56-87b1-449929131db8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:11.118455 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-ce6de04b-e835-4a56-87b1-449929131db8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:11.120043 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-ce6de04b-e835-4a56-87b1-449929131db8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:11.121268 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-ce6de04b-e835-4a56-87b1-449929131db8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1809 microversion: 2.20 time: 0.199496 Sep 06 01:15:11.121915 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 312/603] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:15:10 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1809 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:15:11.231430 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-38fd4f53-84cd-4af2-b316-e435e2e6e4c0 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:11.240498 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-38fd4f53-84cd-4af2-b316-e435e2e6e4c0 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1722 microversion: 2.1 time: 0.149840 Sep 06 01:15:11.241052 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 292/604] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:11 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:11.408120 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-97de275c-8e97-4413-9f78-008d543d92ae tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:11.409217 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-97de275c-8e97-4413-9f78-008d543d92ae tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 70d2092a-968f-45aa-a07c-ee3b6f1a918e] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:11.415116 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-97de275c-8e97-4413-9f78-008d543d92ae tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:11.415719 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-97de275c-8e97-4413-9f78-008d543d92ae tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:11.416176 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-97de275c-8e97-4413-9f78-008d543d92ae tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:11.416886 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-97de275c-8e97-4413-9f78-008d543d92ae tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:11.417332 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-97de275c-8e97-4413-9f78-008d543d92ae tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:11.418045 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-97de275c-8e97-4413-9f78-008d543d92ae tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:11.430812 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-52fa0698-2bc5-4842-a73c-22d679a1be38 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:11.431302 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-52fa0698-2bc5-4842-a73c-22d679a1be38 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:11.437733 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-52fa0698-2bc5-4842-a73c-22d679a1be38 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:11.437869 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-52fa0698-2bc5-4842-a73c-22d679a1be38 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:11.438248 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-52fa0698-2bc5-4842-a73c-22d679a1be38 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:11.438937 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-52fa0698-2bc5-4842-a73c-22d679a1be38 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:11.439387 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-52fa0698-2bc5-4842-a73c-22d679a1be38 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:11.439832 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-52fa0698-2bc5-4842-a73c-22d679a1be38 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:11.837151 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-97de275c-8e97-4413-9f78-008d543d92ae tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:11.845882 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-97de275c-8e97-4413-9f78-008d543d92ae tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e" status: 200 len: 1318 microversion: 2.1 time: 0.441442 Sep 06 01:15:11.847375 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 313/605] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:11 2022] GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e => generated 1318 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:11.862773 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-52fa0698-2bc5-4842-a73c-22d679a1be38 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:11.870932 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-52fa0698-2bc5-4842-a73c-22d679a1be38 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5" status: 200 len: 1683 microversion: 2.1 time: 0.444005 Sep 06 01:15:11.871516 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 293/606] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:11 2022] GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5 => generated 1683 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:12.114415 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-f3bf6838-dc38-4491-a81a-042915cfe9d4 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:12.115035 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-f3bf6838-dc38-4491-a81a-042915cfe9d4 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:12.122560 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f3bf6838-dc38-4491-a81a-042915cfe9d4 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:12.123012 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f3bf6838-dc38-4491-a81a-042915cfe9d4 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:12.123469 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f3bf6838-dc38-4491-a81a-042915cfe9d4 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:12.124408 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f3bf6838-dc38-4491-a81a-042915cfe9d4 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:12.124870 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f3bf6838-dc38-4491-a81a-042915cfe9d4 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:12.125300 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f3bf6838-dc38-4491-a81a-042915cfe9d4 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:12.158540 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dd2d1fa2-9f0a-4edd-9ecc-e5775992556a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:12.159720 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-dd2d1fa2-9f0a-4edd-9ecc-e5775992556a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:12.176240 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd2d1fa2-9f0a-4edd-9ecc-e5775992556a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:12.177133 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd2d1fa2-9f0a-4edd-9ecc-e5775992556a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:12.178639 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd2d1fa2-9f0a-4edd-9ecc-e5775992556a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:12.180032 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd2d1fa2-9f0a-4edd-9ecc-e5775992556a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:12.181365 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd2d1fa2-9f0a-4edd-9ecc-e5775992556a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:12.181985 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd2d1fa2-9f0a-4edd-9ecc-e5775992556a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:12.321412 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-f3bf6838-dc38-4491-a81a-042915cfe9d4 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:12.329090 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-f3bf6838-dc38-4491-a81a-042915cfe9d4 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1359 microversion: 2.1 time: 0.219133 Sep 06 01:15:12.329656 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 314/607] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:12 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1359 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:12.334934 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-7f930b65-cf29-47e5-9912-9b4db71b4866 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:12.335715 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-7f930b65-cf29-47e5-9912-9b4db71b4866 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:12.341450 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7f930b65-cf29-47e5-9912-9b4db71b4866 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:12.341937 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7f930b65-cf29-47e5-9912-9b4db71b4866 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:12.342379 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7f930b65-cf29-47e5-9912-9b4db71b4866 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:12.343068 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7f930b65-cf29-47e5-9912-9b4db71b4866 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:12.343518 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7f930b65-cf29-47e5-9912-9b4db71b4866 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:12.343975 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7f930b65-cf29-47e5-9912-9b4db71b4866 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:12.348120 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-dd2d1fa2-9f0a-4edd-9ecc-e5775992556a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:12.356733 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-dd2d1fa2-9f0a-4edd-9ecc-e5775992556a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:12.358185 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-dd2d1fa2-9f0a-4edd-9ecc-e5775992556a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:12.359355 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dd2d1fa2-9f0a-4edd-9ecc-e5775992556a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1796 microversion: 2.20 time: 0.216508 Sep 06 01:15:12.359955 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 294/608] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:15:12 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1796 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:15:12.469402 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-7f930b65-cf29-47e5-9912-9b4db71b4866 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:12.477965 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-7f930b65-cf29-47e5-9912-9b4db71b4866 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1722 microversion: 2.1 time: 0.147102 Sep 06 01:15:12.478531 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 315/609] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:12 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:12.870443 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-45872da1-5558-4f47-be3b-620788802ccc tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:12.871161 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-45872da1-5558-4f47-be3b-620788802ccc tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 70d2092a-968f-45aa-a07c-ee3b6f1a918e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:12.877018 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-45872da1-5558-4f47-be3b-620788802ccc tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:12.878006 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-45872da1-5558-4f47-be3b-620788802ccc tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:12.878431 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-45872da1-5558-4f47-be3b-620788802ccc tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:12.879153 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-45872da1-5558-4f47-be3b-620788802ccc tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:12.879600 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-45872da1-5558-4f47-be3b-620788802ccc tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:12.880045 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-45872da1-5558-4f47-be3b-620788802ccc tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:12.895492 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-681832cb-7d22-4277-a2f8-c67cb1b2db89 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:12.897444 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-681832cb-7d22-4277-a2f8-c67cb1b2db89 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:12.903523 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-681832cb-7d22-4277-a2f8-c67cb1b2db89 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:12.904167 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-681832cb-7d22-4277-a2f8-c67cb1b2db89 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:12.904715 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-681832cb-7d22-4277-a2f8-c67cb1b2db89 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:12.905614 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-681832cb-7d22-4277-a2f8-c67cb1b2db89 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:12.906194 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-681832cb-7d22-4277-a2f8-c67cb1b2db89 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:12.906753 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-681832cb-7d22-4277-a2f8-c67cb1b2db89 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:13.083509 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-45872da1-5558-4f47-be3b-620788802ccc tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:13.086593 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-681832cb-7d22-4277-a2f8-c67cb1b2db89 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:13.098540 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-681832cb-7d22-4277-a2f8-c67cb1b2db89 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5" status: 200 len: 1683 microversion: 2.1 time: 0.207711 Sep 06 01:15:13.099494 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 316/610] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:12 2022] GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5 => generated 1683 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:15:13.100034 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-45872da1-5558-4f47-be3b-620788802ccc tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e" status: 200 len: 1507 microversion: 2.1 time: 0.232828 Sep 06 01:15:13.103902 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 295/611] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:12 2022] GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e => generated 1507 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:13.122861 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-c889dfac-7abd-463f-9646-8c95f91dbe81 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f266c6ac-784f-4b4a-8a97-72db1e5e0737", "device": "/dev/sdb"}} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:15:13.125888 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-c889dfac-7abd-463f-9646-8c95f91dbe81 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 70d2092a-968f-45aa-a07c-ee3b6f1a918e] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:13.133055 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c889dfac-7abd-463f-9646-8c95f91dbe81 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:13.133538 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c889dfac-7abd-463f-9646-8c95f91dbe81 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:13.133978 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c889dfac-7abd-463f-9646-8c95f91dbe81 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:13.134677 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c889dfac-7abd-463f-9646-8c95f91dbe81 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:13.135134 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c889dfac-7abd-463f-9646-8c95f91dbe81 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:13.135558 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c889dfac-7abd-463f-9646-8c95f91dbe81 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:13.352687 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-05605605-caf8-4d09-ae67-82e046d6cf9c tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:13.353358 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-05605605-caf8-4d09-ae67-82e046d6cf9c tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:13.359914 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05605605-caf8-4d09-ae67-82e046d6cf9c tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:13.360400 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05605605-caf8-4d09-ae67-82e046d6cf9c tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:13.360838 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05605605-caf8-4d09-ae67-82e046d6cf9c tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:13.361532 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05605605-caf8-4d09-ae67-82e046d6cf9c tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:13.362496 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05605605-caf8-4d09-ae67-82e046d6cf9c tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:13.362939 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05605605-caf8-4d09-ae67-82e046d6cf9c tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:13.493195 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-05605605-caf8-4d09-ae67-82e046d6cf9c tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:13.501965 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-05605605-caf8-4d09-ae67-82e046d6cf9c tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1359 microversion: 2.1 time: 0.153112 Sep 06 01:15:13.502782 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 296/612] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:13 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:15:13.516634 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b40c90b8-5aae-4af2-9791-b19ca19ef98c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:13.520580 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b40c90b8-5aae-4af2-9791-b19ca19ef98c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:13.527342 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b40c90b8-5aae-4af2-9791-b19ca19ef98c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:13.528128 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b40c90b8-5aae-4af2-9791-b19ca19ef98c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:13.528794 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b40c90b8-5aae-4af2-9791-b19ca19ef98c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:13.529586 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b40c90b8-5aae-4af2-9791-b19ca19ef98c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:13.530125 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b40c90b8-5aae-4af2-9791-b19ca19ef98c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:13.530627 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b40c90b8-5aae-4af2-9791-b19ca19ef98c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:13.676985 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-b40c90b8-5aae-4af2-9791-b19ca19ef98c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:13.685410 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b40c90b8-5aae-4af2-9791-b19ca19ef98c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1722 microversion: 2.1 time: 0.181588 Sep 06 01:15:13.685921 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 297/613] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:13 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:13.690470 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-64fc1fa6-1f54-4f38-8dec-d281da16551a req-be5134d3-4c39-44f4-8a62-71a9bb7a718f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9a2a405-dce3-4320-b44d-a19c556501b5", "name": "network-vif-deleted", "tag": "1d34bce1-fa87-41f6-98ae-7a1f148c1081"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:15:13.699888 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-64fc1fa6-1f54-4f38-8dec-d281da16551a req-be5134d3-4c39-44f4-8a62-71a9bb7a718f service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:13.700434 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-64fc1fa6-1f54-4f38-8dec-d281da16551a req-be5134d3-4c39-44f4-8a62-71a9bb7a718f service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:13.701067 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-64fc1fa6-1f54-4f38-8dec-d281da16551a req-be5134d3-4c39-44f4-8a62-71a9bb7a718f service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:13.712846 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-64fc1fa6-1f54-4f38-8dec-d281da16551a req-be5134d3-4c39-44f4-8a62-71a9bb7a718f service nova] Creating event network-vif-deleted:1d34bce1-fa87-41f6-98ae-7a1f148c1081 for instance f9a2a405-dce3-4320-b44d-a19c556501b5 on hv-cinder-84773 Sep 06 01:15:13.718084 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-64fc1fa6-1f54-4f38-8dec-d281da16551a req-be5134d3-4c39-44f4-8a62-71a9bb7a718f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031002 Sep 06 01:15:13.718658 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 298/614] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:15:14.124231 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4426874a-6a95-4cdb-a1e9-917b6a8c374d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:14.125384 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4426874a-6a95-4cdb-a1e9-917b6a8c374d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:14.134290 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4426874a-6a95-4cdb-a1e9-917b6a8c374d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:14.134913 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4426874a-6a95-4cdb-a1e9-917b6a8c374d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:14.135349 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4426874a-6a95-4cdb-a1e9-917b6a8c374d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:14.136479 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4426874a-6a95-4cdb-a1e9-917b6a8c374d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:14.136932 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4426874a-6a95-4cdb-a1e9-917b6a8c374d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:14.137356 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4426874a-6a95-4cdb-a1e9-917b6a8c374d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:14.192906 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4426874a-6a95-4cdb-a1e9-917b6a8c374d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:14.193354 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4426874a-6a95-4cdb-a1e9-917b6a8c374d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:14.193794 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4426874a-6a95-4cdb-a1e9-917b6a8c374d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:14.194278 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-4426874a-6a95-4cdb-a1e9-917b6a8c374d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lazy-loading 'fault' on Instance uuid f9a2a405-dce3-4320-b44d-a19c556501b5 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 01:15:14.227589 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-c889dfac-7abd-463f-9646-8c95f91dbe81 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "POST /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.108377 Sep 06 01:15:14.229217 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 317/615] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Sep 6 01:15:13 2022] POST /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e/os-volume_attachments => generated 194 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 01:15:14.244965 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-4426874a-6a95-4cdb-a1e9-917b6a8c374d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:14.253893 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4426874a-6a95-4cdb-a1e9-917b6a8c374d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5" status: 200 len: 1332 microversion: 2.1 time: 0.135000 Sep 06 01:15:14.255856 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 299/616] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:14 2022] GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5 => generated 1332 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:14.526388 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-b3c609ef-a4d1-49b0-82ec-43eda9dd77ee tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:14.527097 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-b3c609ef-a4d1-49b0-82ec-43eda9dd77ee tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:14.533772 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b3c609ef-a4d1-49b0-82ec-43eda9dd77ee tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:14.534473 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b3c609ef-a4d1-49b0-82ec-43eda9dd77ee tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:14.534945 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b3c609ef-a4d1-49b0-82ec-43eda9dd77ee tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:14.535655 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b3c609ef-a4d1-49b0-82ec-43eda9dd77ee tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:14.536133 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b3c609ef-a4d1-49b0-82ec-43eda9dd77ee tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:14.536562 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b3c609ef-a4d1-49b0-82ec-43eda9dd77ee tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:14.676725 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-b3c609ef-a4d1-49b0-82ec-43eda9dd77ee tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:14.686005 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-b3c609ef-a4d1-49b0-82ec-43eda9dd77ee tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1359 microversion: 2.1 time: 0.164315 Sep 06 01:15:14.686989 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 318/617] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:14 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:14.708779 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5cefb2fd-16a6-41be-a497-36efdcd7d20b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:14.709401 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5cefb2fd-16a6-41be-a497-36efdcd7d20b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:14.724152 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5cefb2fd-16a6-41be-a497-36efdcd7d20b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:14.724152 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5cefb2fd-16a6-41be-a497-36efdcd7d20b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:14.724152 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5cefb2fd-16a6-41be-a497-36efdcd7d20b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:14.724152 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5cefb2fd-16a6-41be-a497-36efdcd7d20b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:14.724535 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5cefb2fd-16a6-41be-a497-36efdcd7d20b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:14.724535 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5cefb2fd-16a6-41be-a497-36efdcd7d20b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:14.888671 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-5cefb2fd-16a6-41be-a497-36efdcd7d20b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:14.898389 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5cefb2fd-16a6-41be-a497-36efdcd7d20b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1722 microversion: 2.1 time: 0.193858 Sep 06 01:15:14.899089 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 300/618] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:14 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:15.278554 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-d2d55bf2-9117-4e5c-aeae-7a346bb58aae tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:15.279196 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-d2d55bf2-9117-4e5c-aeae-7a346bb58aae tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:15.286359 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d2d55bf2-9117-4e5c-aeae-7a346bb58aae tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:15.286845 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d2d55bf2-9117-4e5c-aeae-7a346bb58aae tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:15.287279 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d2d55bf2-9117-4e5c-aeae-7a346bb58aae tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:15.288002 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d2d55bf2-9117-4e5c-aeae-7a346bb58aae tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:15.288451 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d2d55bf2-9117-4e5c-aeae-7a346bb58aae tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:15.288875 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d2d55bf2-9117-4e5c-aeae-7a346bb58aae tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:15.303437 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.wsgi [None req-d2d55bf2-9117-4e5c-aeae-7a346bb58aae tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] HTTP exception thrown: Instance f9a2a405-dce3-4320-b44d-a19c556501b5 could not be found. Sep 06 01:15:15.305110 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-d2d55bf2-9117-4e5c-aeae-7a346bb58aae tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Request method failure captured: Sep 06 01:15:15.305110 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: request: GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5 HTTP/1.1 Sep 06 01:15:15.305110 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept: application/json Sep 06 01:15:15.305110 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept-Encoding: identity Sep 06 01:15:15.305110 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Connection: close Sep 06 01:15:15.305110 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Length: 0 Sep 06 01:15:15.305110 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Type: application/json Sep 06 01:15:15.305110 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Host: 10.222.0.23 Sep 06 01:15:15.305110 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Openstack-System-Scope: None Sep 06 01:15:15.305110 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: User-Agent: python-urllib3/1.26.12 Sep 06 01:15:15.305110 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Auth-Token: gAAAAABjFp5HgEJZI7pOCAbhWXwWFE8yQ5t7K_Ws-jshDHbF7sXnYLPl16IIONgrpvYxWiZSDSAeitprugb5h17_eYSiBNUfLgmC9hbcnAOoP7NTvslLSb0CTURVLZpiFrwKL1VvcCbnqL_bQbP7LRSB17fvFEoXQ1dcjQQQPX7LNrOn0pG4F5A Sep 06 01:15:15.305110 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Id: None Sep 06 01:15:15.305110 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Name: None Sep 06 01:15:15.305110 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Identity-Status: Confirmed Sep 06 01:15:15.305110 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Is-Admin-Project: True Sep 06 01:15:15.305110 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Id: default Sep 06 01:15:15.305110 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Name: Default Sep 06 01:15:15.305110 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Id: 1fa73b0bfee14a9ea25f03e523078995 Sep 06 01:15:15.305110 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Name: tempest-AttachVolumeNegativeTest-1412452604 Sep 06 01:15:15.305110 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Role: reader,member Sep 06 01:15:15.305110 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Roles: reader,member Sep 06 01:15:15.306605 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1fa73b0bfee14a9ea25f03e523078995"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1fa73b0bfee14a9ea25f03e523078995"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1fa73b0bfee14a9ea25f03e523078995"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1fa73b0bfee14a9ea25f03e523078995"}]}] Sep 06 01:15:15.306605 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant: tempest-AttachVolumeNegativeTest-1412452604 Sep 06 01:15:15.306605 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Id: 1fa73b0bfee14a9ea25f03e523078995 Sep 06 01:15:15.306605 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1412452604 Sep 06 01:15:15.306605 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User: tempest-AttachVolumeNegativeTest-1412452604-project Sep 06 01:15:15.306605 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Id: default Sep 06 01:15:15.306605 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Name: Default Sep 06 01:15:15.306605 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Id: f8f44df824414e5ebc8cfd2126e9d66f Sep 06 01:15:15.306605 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Name: tempest-AttachVolumeNegativeTest-1412452604-project Sep 06 01:15:15.306605 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: method: > Sep 06 01:15:15.306605 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: exception: Instance f9a2a405-dce3-4320-b44d-a19c556501b5 could not be found. Sep 06 01:15:15.306605 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: action_args: {'id': 'f9a2a405-dce3-4320-b44d-a19c556501b5'} Sep 06 01:15:15.310595 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:15:15.310595 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:15:15.310595 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 01:15:15.310595 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 01:15:15.310595 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 01:15:15.310595 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 01:15:15.310595 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 01:15:15.310595 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 01:15:15.310595 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 01:15:15.310595 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 01:15:15.310595 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9a2a405-dce3-4320-b44d-a19c556501b5 could not be found. Sep 06 01:15:15.310595 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:15:15.310595 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:15:15.310595 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:15:15.310595 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:15:15.310595 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:15:15.310595 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:15:15.310595 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:15:15.310595 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:15:15.310595 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:15:15.311809 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:15:15.311809 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 01:15:15.311809 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 01:15:15.311809 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 01:15:15.311809 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 01:15:15.311809 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 01:15:15.311809 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:15:15.311809 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9a2a405-dce3-4320-b44d-a19c556501b5 could not be found. Sep 06 01:15:15.311809 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:15:15.311809 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:15:15.311809 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:15:15.311809 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:15:15.311809 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:15:15.311809 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:15:15.311809 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:15:15.311809 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:15:15.311809 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9a2a405-dce3-4320-b44d-a19c556501b5 could not be found. Sep 06 01:15:15.311809 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:15:15.312878 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-d2d55bf2-9117-4e5c-aeae-7a346bb58aae tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Returning 404 to user: Instance f9a2a405-dce3-4320-b44d-a19c556501b5 could not be found. {{(pid=120580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:15:15.312878 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-d2d55bf2-9117-4e5c-aeae-7a346bb58aae tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5" status: 404 len: 111 microversion: 2.1 time: 0.031802 Sep 06 01:15:15.312878 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 319/619] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:15 2022] GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 01:15:15.320825 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-16368dfd-1d8f-4f82-8c1d-4cd46fa3dfd8 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '.version_select at 0x7fb06e0b91f0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:15.341216 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-16368dfd-1d8f-4f82-8c1d-4cd46fa3dfd8 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1364060931" status: 202 len: 0 microversion: 2.1 time: 0.026664 Sep 06 01:15:15.341791 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 301/620] 10.222.0.23 () {58 vars in 1221 bytes} [Tue Sep 6 01:15:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1364060931 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 01:15:15.779731 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-d09c1b8e-a26a-4643-a3fe-6f78884f5158 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:15.780450 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-d09c1b8e-a26a-4643-a3fe-6f78884f5158 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:15.787741 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d09c1b8e-a26a-4643-a3fe-6f78884f5158 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:15.788493 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d09c1b8e-a26a-4643-a3fe-6f78884f5158 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:15.788930 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d09c1b8e-a26a-4643-a3fe-6f78884f5158 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:15.789622 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d09c1b8e-a26a-4643-a3fe-6f78884f5158 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:15.790253 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d09c1b8e-a26a-4643-a3fe-6f78884f5158 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:15.790808 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d09c1b8e-a26a-4643-a3fe-6f78884f5158 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:15.923945 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5e671ce2-12bf-4acc-8f99-cbf3d9292df0 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:15.925090 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5e671ce2-12bf-4acc-8f99-cbf3d9292df0 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:15.931565 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-d09c1b8e-a26a-4643-a3fe-6f78884f5158 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:15.938455 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e671ce2-12bf-4acc-8f99-cbf3d9292df0 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:15.938959 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e671ce2-12bf-4acc-8f99-cbf3d9292df0 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:15.940006 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e671ce2-12bf-4acc-8f99-cbf3d9292df0 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:15.940145 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e671ce2-12bf-4acc-8f99-cbf3d9292df0 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:15.940590 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e671ce2-12bf-4acc-8f99-cbf3d9292df0 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:15.941093 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e671ce2-12bf-4acc-8f99-cbf3d9292df0 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:15.949359 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-d09c1b8e-a26a-4643-a3fe-6f78884f5158 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1359 microversion: 2.1 time: 0.173492 Sep 06 01:15:15.964653 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 320/621] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:15 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:16.028550 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-a46794ad-1ce1-473d-b21e-4079298316df tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:16.029050 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-a46794ad-1ce1-473d-b21e-4079298316df tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:16.035563 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a46794ad-1ce1-473d-b21e-4079298316df tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:16.036027 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a46794ad-1ce1-473d-b21e-4079298316df tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:16.036475 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a46794ad-1ce1-473d-b21e-4079298316df tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:16.037177 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a46794ad-1ce1-473d-b21e-4079298316df tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:16.037631 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a46794ad-1ce1-473d-b21e-4079298316df tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:16.038199 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a46794ad-1ce1-473d-b21e-4079298316df tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:16.081130 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-5e671ce2-12bf-4acc-8f99-cbf3d9292df0 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:16.090193 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5e671ce2-12bf-4acc-8f99-cbf3d9292df0 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1722 microversion: 2.1 time: 0.171144 Sep 06 01:15:16.090902 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 302/622] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:15 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:16.130144 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.objects.instance [None req-a46794ad-1ce1-473d-b21e-4079298316df tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lazy-loading 'services' on Instance uuid b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e {{(pid=120580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 01:15:16.211426 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-a46794ad-1ce1-473d-b21e-4079298316df tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e/os-volume_attachments/8ac6fa67-d970-433d-be24-0bc4bed540dc" status: 202 len: 0 microversion: 2.1 time: 0.186561 Sep 06 01:15:16.212107 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 321/623] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Sep 6 01:15:16 2022] DELETE /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e/os-volume_attachments/8ac6fa67-d970-433d-be24-0bc4bed540dc => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 01:15:16.220714 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9c03aad2-c579-4b12-8c0f-7134a254e10e tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:16.223584 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9c03aad2-c579-4b12-8c0f-7134a254e10e tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:16.232346 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c03aad2-c579-4b12-8c0f-7134a254e10e tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:16.233574 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c03aad2-c579-4b12-8c0f-7134a254e10e tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:16.234182 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c03aad2-c579-4b12-8c0f-7134a254e10e tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:16.234902 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c03aad2-c579-4b12-8c0f-7134a254e10e tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:16.235555 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c03aad2-c579-4b12-8c0f-7134a254e10e tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:16.236039 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c03aad2-c579-4b12-8c0f-7134a254e10e tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:16.259272 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:15:16.280093 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9c03aad2-c579-4b12-8c0f-7134a254e10e tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063298 Sep 06 01:15:16.281259 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 303/624] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 6 01:15:16 2022] GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:15:16.973071 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-4c9425df-66ca-4151-8796-257024b4f777 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:16.973778 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-4c9425df-66ca-4151-8796-257024b4f777 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:16.980003 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4c9425df-66ca-4151-8796-257024b4f777 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:16.980485 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4c9425df-66ca-4151-8796-257024b4f777 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:16.980923 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4c9425df-66ca-4151-8796-257024b4f777 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:16.981641 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4c9425df-66ca-4151-8796-257024b4f777 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:16.982096 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4c9425df-66ca-4151-8796-257024b4f777 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:16.982524 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4c9425df-66ca-4151-8796-257024b4f777 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:17.112371 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-4c9425df-66ca-4151-8796-257024b4f777 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:17.117145 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a6094028-f7be-4598-be60-ded113d6bfa8 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:17.117787 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a6094028-f7be-4598-be60-ded113d6bfa8 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:17.120250 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-4c9425df-66ca-4151-8796-257024b4f777 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1359 microversion: 2.1 time: 0.151779 Sep 06 01:15:17.120823 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 322/625] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:16 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:17.124392 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6094028-f7be-4598-be60-ded113d6bfa8 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:17.124870 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6094028-f7be-4598-be60-ded113d6bfa8 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:17.125302 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6094028-f7be-4598-be60-ded113d6bfa8 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:17.125985 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6094028-f7be-4598-be60-ded113d6bfa8 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:17.126433 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6094028-f7be-4598-be60-ded113d6bfa8 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:17.126849 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6094028-f7be-4598-be60-ded113d6bfa8 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:17.252855 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-a6094028-f7be-4598-be60-ded113d6bfa8 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:17.260847 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a6094028-f7be-4598-be60-ded113d6bfa8 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1722 microversion: 2.1 time: 0.147569 Sep 06 01:15:17.261400 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 304/626] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:17 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:15:17.293759 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-923a1875-b3c1-4176-918d-b7d8ec564445 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:17.296030 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-923a1875-b3c1-4176-918d-b7d8ec564445 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:17.302517 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-923a1875-b3c1-4176-918d-b7d8ec564445 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:17.302996 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-923a1875-b3c1-4176-918d-b7d8ec564445 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:17.303429 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-923a1875-b3c1-4176-918d-b7d8ec564445 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:17.304143 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-923a1875-b3c1-4176-918d-b7d8ec564445 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:17.304591 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-923a1875-b3c1-4176-918d-b7d8ec564445 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:17.305014 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-923a1875-b3c1-4176-918d-b7d8ec564445 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:17.332860 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-923a1875-b3c1-4176-918d-b7d8ec564445 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043306 Sep 06 01:15:17.333390 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 323/627] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 6 01:15:17 2022] GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:15:18.143962 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3b5e11c7-325c-4ebe-8025-0a12be3ffecd tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:18.144706 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3b5e11c7-325c-4ebe-8025-0a12be3ffecd tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:18.151109 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3b5e11c7-325c-4ebe-8025-0a12be3ffecd tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:18.152121 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3b5e11c7-325c-4ebe-8025-0a12be3ffecd tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:18.152564 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3b5e11c7-325c-4ebe-8025-0a12be3ffecd tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:18.153260 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3b5e11c7-325c-4ebe-8025-0a12be3ffecd tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:18.153724 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3b5e11c7-325c-4ebe-8025-0a12be3ffecd tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:18.154147 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3b5e11c7-325c-4ebe-8025-0a12be3ffecd tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:18.247340 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-089c0619-acef-4fca-8a5f-a4158fb011d0 req-baa6c6a9-2b93-40d7-ba73-e71eb8a8fe41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "590890af-37ec-4cde-b2f7-0b20cc31b43d", "name": "network-vif-plugged", "status": "completed", "tag": "c382089c-3c7e-40e3-825b-3469de858075"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:15:18.264076 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-089c0619-acef-4fca-8a5f-a4158fb011d0 req-baa6c6a9-2b93-40d7-ba73-e71eb8a8fe41 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:18.264799 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-089c0619-acef-4fca-8a5f-a4158fb011d0 req-baa6c6a9-2b93-40d7-ba73-e71eb8a8fe41 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:18.265446 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-089c0619-acef-4fca-8a5f-a4158fb011d0 req-baa6c6a9-2b93-40d7-ba73-e71eb8a8fe41 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:18.282109 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.compute.server_external_events [req-089c0619-acef-4fca-8a5f-a4158fb011d0 req-baa6c6a9-2b93-40d7-ba73-e71eb8a8fe41 service nova] Creating event network-vif-plugged:c382089c-3c7e-40e3-825b-3469de858075 for instance 590890af-37ec-4cde-b2f7-0b20cc31b43d on hv-cinder-84773 Sep 06 01:15:18.287417 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [req-089c0619-acef-4fca-8a5f-a4158fb011d0 req-baa6c6a9-2b93-40d7-ba73-e71eb8a8fe41 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046697 Sep 06 01:15:18.288357 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 324/628] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 01:15:18.294600 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-eebd8aa7-971a-4b34-b527-d3ae43030da6 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:18.295040 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-3b5e11c7-325c-4ebe-8025-0a12be3ffecd tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:18.295451 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-eebd8aa7-971a-4b34-b527-d3ae43030da6 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:18.302121 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-eebd8aa7-971a-4b34-b527-d3ae43030da6 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:18.302777 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-eebd8aa7-971a-4b34-b527-d3ae43030da6 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:18.303428 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3b5e11c7-325c-4ebe-8025-0a12be3ffecd tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1359 microversion: 2.1 time: 0.163951 Sep 06 01:15:18.304052 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 305/629] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:18 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:18.316066 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-eebd8aa7-971a-4b34-b527-d3ae43030da6 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:18.320199 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-eebd8aa7-971a-4b34-b527-d3ae43030da6 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:18.320199 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-eebd8aa7-971a-4b34-b527-d3ae43030da6 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:18.320199 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-eebd8aa7-971a-4b34-b527-d3ae43030da6 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:18.344738 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6a5e6106-0623-454e-8e61-66fb71969c96 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:18.347297 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6a5e6106-0623-454e-8e61-66fb71969c96 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:18.354662 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6a5e6106-0623-454e-8e61-66fb71969c96 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:18.355279 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6a5e6106-0623-454e-8e61-66fb71969c96 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:18.355859 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6a5e6106-0623-454e-8e61-66fb71969c96 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:18.356688 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6a5e6106-0623-454e-8e61-66fb71969c96 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:18.357370 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6a5e6106-0623-454e-8e61-66fb71969c96 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:18.358075 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6a5e6106-0623-454e-8e61-66fb71969c96 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:18.392615 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6a5e6106-0623-454e-8e61-66fb71969c96 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051974 Sep 06 01:15:18.398373 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 306/630] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 6 01:15:18 2022] GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 01:15:18.459571 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-eebd8aa7-971a-4b34-b527-d3ae43030da6 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:18.467893 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-eebd8aa7-971a-4b34-b527-d3ae43030da6 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1699 microversion: 2.1 time: 0.178242 Sep 06 01:15:18.468458 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 325/631] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:18 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1699 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:18.491386 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d4ec6e76-a4d0-4058-bc18-fe02aa7d990c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:15:18.497529 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4ec6e76-a4d0-4058-bc18-fe02aa7d990c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:18.498791 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4ec6e76-a4d0-4058-bc18-fe02aa7d990c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:18.499248 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4ec6e76-a4d0-4058-bc18-fe02aa7d990c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:18.560762 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d4ec6e76-a4d0-4058-bc18-fe02aa7d990c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Going to try to start instance {{(pid=120581) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 06 01:15:18.604652 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d4ec6e76-a4d0-4058-bc18-fe02aa7d990c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "POST /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba/action" status: 202 len: 0 microversion: 2.1 time: 0.117617 Sep 06 01:15:18.605209 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 307/632] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Sep 6 01:15:18 2022] POST /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 01:15:18.613798 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-1f454ce1-0206-4617-a7f1-f2cd7beb64cf tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:18.614436 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-1f454ce1-0206-4617-a7f1-f2cd7beb64cf tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:18.620471 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1f454ce1-0206-4617-a7f1-f2cd7beb64cf tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:18.620958 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1f454ce1-0206-4617-a7f1-f2cd7beb64cf tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:18.621396 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1f454ce1-0206-4617-a7f1-f2cd7beb64cf tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:18.622085 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1f454ce1-0206-4617-a7f1-f2cd7beb64cf tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:18.622546 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1f454ce1-0206-4617-a7f1-f2cd7beb64cf tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:18.622973 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1f454ce1-0206-4617-a7f1-f2cd7beb64cf tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:18.750604 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-1f454ce1-0206-4617-a7f1-f2cd7beb64cf tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:18.754970 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:15:18.761252 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-1f454ce1-0206-4617-a7f1-f2cd7beb64cf tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1708 microversion: 2.1 time: 0.151746 Sep 06 01:15:18.761817 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 326/633] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:18 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1708 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:19.329157 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d000a640-6430-4f3d-af7d-cf0b4f047a26 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:19.329859 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d000a640-6430-4f3d-af7d-cf0b4f047a26 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:19.336422 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d000a640-6430-4f3d-af7d-cf0b4f047a26 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:19.336909 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d000a640-6430-4f3d-af7d-cf0b4f047a26 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:19.337346 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d000a640-6430-4f3d-af7d-cf0b4f047a26 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:19.338031 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d000a640-6430-4f3d-af7d-cf0b4f047a26 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:19.338482 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d000a640-6430-4f3d-af7d-cf0b4f047a26 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:19.338907 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d000a640-6430-4f3d-af7d-cf0b4f047a26 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:19.406985 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-4e4c6299-24e6-4ea9-919d-fa136b0be482 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:19.409366 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-4e4c6299-24e6-4ea9-919d-fa136b0be482 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:19.417627 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4e4c6299-24e6-4ea9-919d-fa136b0be482 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:19.418560 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4e4c6299-24e6-4ea9-919d-fa136b0be482 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:19.419005 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4e4c6299-24e6-4ea9-919d-fa136b0be482 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:19.419905 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4e4c6299-24e6-4ea9-919d-fa136b0be482 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:19.420368 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4e4c6299-24e6-4ea9-919d-fa136b0be482 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:19.420798 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4e4c6299-24e6-4ea9-919d-fa136b0be482 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:19.455172 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-4e4c6299-24e6-4ea9-919d-fa136b0be482 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053033 Sep 06 01:15:19.456079 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 327/634] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 6 01:15:19 2022] GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:15:19.477506 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-d000a640-6430-4f3d-af7d-cf0b4f047a26 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:19.483942 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d000a640-6430-4f3d-af7d-cf0b4f047a26 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1359 microversion: 2.1 time: 0.159741 Sep 06 01:15:19.484512 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 308/635] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:19 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:19.784281 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-ea06da66-bcc8-4a1d-b7a3-2ccf2e60f2f5 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:19.784895 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-ea06da66-bcc8-4a1d-b7a3-2ccf2e60f2f5 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:19.790778 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ea06da66-bcc8-4a1d-b7a3-2ccf2e60f2f5 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:19.791254 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ea06da66-bcc8-4a1d-b7a3-2ccf2e60f2f5 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:19.791684 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ea06da66-bcc8-4a1d-b7a3-2ccf2e60f2f5 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:19.792649 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ea06da66-bcc8-4a1d-b7a3-2ccf2e60f2f5 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:19.793102 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ea06da66-bcc8-4a1d-b7a3-2ccf2e60f2f5 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:19.793525 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ea06da66-bcc8-4a1d-b7a3-2ccf2e60f2f5 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:19.926513 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-ea06da66-bcc8-4a1d-b7a3-2ccf2e60f2f5 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:19.934802 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-ea06da66-bcc8-4a1d-b7a3-2ccf2e60f2f5 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1708 microversion: 2.1 time: 0.154341 Sep 06 01:15:19.935357 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 328/636] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:19 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1708 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:20.468772 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-df431ed4-c1db-4b5f-9c70-fad578b55b42 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:20.470942 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-df431ed4-c1db-4b5f-9c70-fad578b55b42 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:20.477800 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df431ed4-c1db-4b5f-9c70-fad578b55b42 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:20.478277 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df431ed4-c1db-4b5f-9c70-fad578b55b42 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:20.478712 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df431ed4-c1db-4b5f-9c70-fad578b55b42 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:20.479391 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df431ed4-c1db-4b5f-9c70-fad578b55b42 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:20.479860 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df431ed4-c1db-4b5f-9c70-fad578b55b42 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:20.480286 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df431ed4-c1db-4b5f-9c70-fad578b55b42 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:20.507188 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-4cfe69ff-27f6-4eb2-875a-59940ff19442 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:20.507912 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-4cfe69ff-27f6-4eb2-875a-59940ff19442 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:20.510254 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-df431ed4-c1db-4b5f-9c70-fad578b55b42 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045440 Sep 06 01:15:20.510866 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 309/637] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 6 01:15:20 2022] GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:15:20.516092 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4cfe69ff-27f6-4eb2-875a-59940ff19442 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:20.516567 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4cfe69ff-27f6-4eb2-875a-59940ff19442 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:20.516999 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4cfe69ff-27f6-4eb2-875a-59940ff19442 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:20.517688 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4cfe69ff-27f6-4eb2-875a-59940ff19442 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:20.518139 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4cfe69ff-27f6-4eb2-875a-59940ff19442 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:20.518557 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4cfe69ff-27f6-4eb2-875a-59940ff19442 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:20.651635 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-4cfe69ff-27f6-4eb2-875a-59940ff19442 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:20.659202 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-4cfe69ff-27f6-4eb2-875a-59940ff19442 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1549 microversion: 2.1 time: 0.156339 Sep 06 01:15:20.660342 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 329/638] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:20 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:15:20.682949 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-06b1297f-aa62-4f1b-a2fd-ca99e62806a1 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:20.683561 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-06b1297f-aa62-4f1b-a2fd-ca99e62806a1 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:20.686654 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:15:20.690676 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-06b1297f-aa62-4f1b-a2fd-ca99e62806a1 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:20.691161 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-06b1297f-aa62-4f1b-a2fd-ca99e62806a1 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:20.691592 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-06b1297f-aa62-4f1b-a2fd-ca99e62806a1 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:20.692310 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-06b1297f-aa62-4f1b-a2fd-ca99e62806a1 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:20.692764 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-06b1297f-aa62-4f1b-a2fd-ca99e62806a1 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:20.693191 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-06b1297f-aa62-4f1b-a2fd-ca99e62806a1 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:20.824681 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-06b1297f-aa62-4f1b-a2fd-ca99e62806a1 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:20.832712 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-06b1297f-aa62-4f1b-a2fd-ca99e62806a1 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1549 microversion: 2.1 time: 0.153600 Sep 06 01:15:20.833274 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 310/639] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:20 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:20.854792 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-25681c8c-2d22-4640-b895-c1b2b6072d20 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:20.859688 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-25681c8c-2d22-4640-b895-c1b2b6072d20 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:20.860371 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-25681c8c-2d22-4640-b895-c1b2b6072d20 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Searching by: {'deleted': False, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f'} {{(pid=120580) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 01:15:20.866859 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-25681c8c-2d22-4640-b895-c1b2b6072d20 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:20.867337 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-25681c8c-2d22-4640-b895-c1b2b6072d20 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:20.867796 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-25681c8c-2d22-4640-b895-c1b2b6072d20 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:20.868513 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-25681c8c-2d22-4640-b895-c1b2b6072d20 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:20.868963 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-25681c8c-2d22-4640-b895-c1b2b6072d20 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:20.869414 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-25681c8c-2d22-4640-b895-c1b2b6072d20 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:20.958278 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.multi_cell_list [None req-25681c8c-2d22-4640-b895-c1b2b6072d20 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120580) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 01:15:20.962887 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fb27cafa-393d-4af8-82a2-d98dc3056509 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:20.963508 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fb27cafa-393d-4af8-82a2-d98dc3056509 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:20.969413 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fb27cafa-393d-4af8-82a2-d98dc3056509 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:20.969893 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fb27cafa-393d-4af8-82a2-d98dc3056509 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:20.970326 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fb27cafa-393d-4af8-82a2-d98dc3056509 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:20.971014 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fb27cafa-393d-4af8-82a2-d98dc3056509 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:20.971466 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fb27cafa-393d-4af8-82a2-d98dc3056509 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:20.971940 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fb27cafa-393d-4af8-82a2-d98dc3056509 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:21.054359 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-25681c8c-2d22-4640-b895-c1b2b6072d20 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.203201 Sep 06 01:15:21.054944 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 330/640] 10.222.0.23 () {58 vars in 1125 bytes} [Tue Sep 6 01:15:20 2022] GET /compute/v2.1/servers => generated 343 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 01:15:21.066998 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-531f621c-f4b8-4e6e-9174-0067eca24533 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:21.067606 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-531f621c-f4b8-4e6e-9174-0067eca24533 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:21.073446 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-531f621c-f4b8-4e6e-9174-0067eca24533 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:21.073934 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-531f621c-f4b8-4e6e-9174-0067eca24533 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:21.074369 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-531f621c-f4b8-4e6e-9174-0067eca24533 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:21.075057 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-531f621c-f4b8-4e6e-9174-0067eca24533 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:21.075508 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-531f621c-f4b8-4e6e-9174-0067eca24533 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:21.075963 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-531f621c-f4b8-4e6e-9174-0067eca24533 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:21.102433 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-fb27cafa-393d-4af8-82a2-d98dc3056509 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:21.110889 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fb27cafa-393d-4af8-82a2-d98dc3056509 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1708 microversion: 2.1 time: 0.151847 Sep 06 01:15:21.111463 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 311/641] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:20 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1708 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:15:21.209450 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-531f621c-f4b8-4e6e-9174-0067eca24533 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:21.217337 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-531f621c-f4b8-4e6e-9174-0067eca24533 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1549 microversion: 2.1 time: 0.154494 Sep 06 01:15:21.228327 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 331/642] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:21 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1549 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:15:21.522590 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d08f654d-574e-49cd-a2d8-3d7a796673f2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:21.525647 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d08f654d-574e-49cd-a2d8-3d7a796673f2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:21.532049 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d08f654d-574e-49cd-a2d8-3d7a796673f2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:21.532535 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d08f654d-574e-49cd-a2d8-3d7a796673f2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:21.532970 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d08f654d-574e-49cd-a2d8-3d7a796673f2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:21.533667 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d08f654d-574e-49cd-a2d8-3d7a796673f2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:21.534116 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d08f654d-574e-49cd-a2d8-3d7a796673f2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:21.534598 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d08f654d-574e-49cd-a2d8-3d7a796673f2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:21.567539 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d08f654d-574e-49cd-a2d8-3d7a796673f2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048959 Sep 06 01:15:21.568137 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 312/643] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 6 01:15:21 2022] GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:15:22.133778 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-43f55424-a63e-46b4-ba62-5a7ca4eb0725 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:22.134309 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-43f55424-a63e-46b4-ba62-5a7ca4eb0725 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:22.140855 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-43f55424-a63e-46b4-ba62-5a7ca4eb0725 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:22.141333 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-43f55424-a63e-46b4-ba62-5a7ca4eb0725 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:22.141762 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-43f55424-a63e-46b4-ba62-5a7ca4eb0725 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:22.142444 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-43f55424-a63e-46b4-ba62-5a7ca4eb0725 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:22.142887 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-43f55424-a63e-46b4-ba62-5a7ca4eb0725 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:22.143304 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-43f55424-a63e-46b4-ba62-5a7ca4eb0725 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:22.268200 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-43f55424-a63e-46b4-ba62-5a7ca4eb0725 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:22.276742 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-43f55424-a63e-46b4-ba62-5a7ca4eb0725 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1712 microversion: 2.1 time: 0.146896 Sep 06 01:15:22.277297 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 332/644] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:22 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1712 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:22.584683 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-df196388-2972-4195-a44c-54f843c65fd4 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:22.587490 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-df196388-2972-4195-a44c-54f843c65fd4 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:22.593900 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df196388-2972-4195-a44c-54f843c65fd4 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:22.594377 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df196388-2972-4195-a44c-54f843c65fd4 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:22.594813 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df196388-2972-4195-a44c-54f843c65fd4 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:22.595500 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df196388-2972-4195-a44c-54f843c65fd4 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:22.595976 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df196388-2972-4195-a44c-54f843c65fd4 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:22.596396 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df196388-2972-4195-a44c-54f843c65fd4 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:22.625705 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-df196388-2972-4195-a44c-54f843c65fd4 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049500 Sep 06 01:15:22.626255 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 313/645] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 6 01:15:22 2022] GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:15:22.759489 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-88d8fbc8-fdf9-4c7b-8b4d-537666b17423 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0501b5ca-12b9-4092-acee-db360247b463"}} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:15:22.761928 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-88d8fbc8-fdf9-4c7b-8b4d-537666b17423 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:22.767885 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-88d8fbc8-fdf9-4c7b-8b4d-537666b17423 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:22.768369 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-88d8fbc8-fdf9-4c7b-8b4d-537666b17423 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:22.768802 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-88d8fbc8-fdf9-4c7b-8b4d-537666b17423 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:22.769490 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-88d8fbc8-fdf9-4c7b-8b4d-537666b17423 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:22.769939 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-88d8fbc8-fdf9-4c7b-8b4d-537666b17423 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:22.770571 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-88d8fbc8-fdf9-4c7b-8b4d-537666b17423 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:23.109526 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-88d8fbc8-fdf9-4c7b-8b4d-537666b17423 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "POST /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.354187 Sep 06 01:15:23.110172 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 333/646] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Sep 6 01:15:22 2022] POST /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d/os-volume_attachments => generated 194 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:15:23.638440 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-52b6690c-f736-441e-b0fc-40c9cbc067e7 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:23.640598 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-52b6690c-f736-441e-b0fc-40c9cbc067e7 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:23.646931 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-52b6690c-f736-441e-b0fc-40c9cbc067e7 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:23.647405 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-52b6690c-f736-441e-b0fc-40c9cbc067e7 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:23.647858 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-52b6690c-f736-441e-b0fc-40c9cbc067e7 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:23.648595 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-52b6690c-f736-441e-b0fc-40c9cbc067e7 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:23.649046 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-52b6690c-f736-441e-b0fc-40c9cbc067e7 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:23.649461 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-52b6690c-f736-441e-b0fc-40c9cbc067e7 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:23.678681 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-52b6690c-f736-441e-b0fc-40c9cbc067e7 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044431 Sep 06 01:15:23.679226 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 314/647] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 6 01:15:23 2022] GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:15:24.691637 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-d2910de5-f71f-4a9d-b5e1-b5c69e47b60f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:24.693927 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-d2910de5-f71f-4a9d-b5e1-b5c69e47b60f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:24.699998 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d2910de5-f71f-4a9d-b5e1-b5c69e47b60f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:24.700473 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d2910de5-f71f-4a9d-b5e1-b5c69e47b60f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:24.700902 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d2910de5-f71f-4a9d-b5e1-b5c69e47b60f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:24.701580 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d2910de5-f71f-4a9d-b5e1-b5c69e47b60f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:24.702022 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d2910de5-f71f-4a9d-b5e1-b5c69e47b60f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:24.702436 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d2910de5-f71f-4a9d-b5e1-b5c69e47b60f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:24.731061 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-d2910de5-f71f-4a9d-b5e1-b5c69e47b60f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044211 Sep 06 01:15:24.731604 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 334/648] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 6 01:15:24 2022] GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:15:25.743903 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6e71800a-aa43-4e42-b6c4-90a27b8b8025 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:25.746076 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6e71800a-aa43-4e42-b6c4-90a27b8b8025 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:25.752662 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e71800a-aa43-4e42-b6c4-90a27b8b8025 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:25.753145 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e71800a-aa43-4e42-b6c4-90a27b8b8025 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:25.753580 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e71800a-aa43-4e42-b6c4-90a27b8b8025 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:25.754268 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e71800a-aa43-4e42-b6c4-90a27b8b8025 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:25.755286 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e71800a-aa43-4e42-b6c4-90a27b8b8025 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:25.755830 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e71800a-aa43-4e42-b6c4-90a27b8b8025 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:25.784494 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6e71800a-aa43-4e42-b6c4-90a27b8b8025 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044607 Sep 06 01:15:25.785048 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 315/649] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 6 01:15:25 2022] GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:15:26.798762 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-fc1fe337-cd97-42d5-b62c-994fdf978504 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:26.800886 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-fc1fe337-cd97-42d5-b62c-994fdf978504 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:26.807883 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fc1fe337-cd97-42d5-b62c-994fdf978504 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:26.808369 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fc1fe337-cd97-42d5-b62c-994fdf978504 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:26.808805 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fc1fe337-cd97-42d5-b62c-994fdf978504 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:26.809492 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fc1fe337-cd97-42d5-b62c-994fdf978504 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:26.809953 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fc1fe337-cd97-42d5-b62c-994fdf978504 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:26.810382 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fc1fe337-cd97-42d5-b62c-994fdf978504 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:26.839419 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-fc1fe337-cd97-42d5-b62c-994fdf978504 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044953 Sep 06 01:15:26.839930 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 335/650] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 6 01:15:26 2022] GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 01:15:26.902251 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-293a782f-c8d8-4679-81cb-99ae9fe0bda0 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:26.902728 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-293a782f-c8d8-4679-81cb-99ae9fe0bda0 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:26.910011 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-293a782f-c8d8-4679-81cb-99ae9fe0bda0 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:26.911259 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-293a782f-c8d8-4679-81cb-99ae9fe0bda0 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:26.912008 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-293a782f-c8d8-4679-81cb-99ae9fe0bda0 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:26.912848 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-293a782f-c8d8-4679-81cb-99ae9fe0bda0 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:26.913441 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-293a782f-c8d8-4679-81cb-99ae9fe0bda0 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:26.914124 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-293a782f-c8d8-4679-81cb-99ae9fe0bda0 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:26.939814 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-293a782f-c8d8-4679-81cb-99ae9fe0bda0 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 01:15:27.018048 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-293a782f-c8d8-4679-81cb-99ae9fe0bda0 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e" status: 204 len: 0 microversion: 2.1 time: 0.119289 Sep 06 01:15:27.021901 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 316/651] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 6 01:15:26 2022] DELETE /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 01:15:27.029053 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-5d7885a0-626e-4f7d-a97f-ef6924726290 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:27.029681 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-5d7885a0-626e-4f7d-a97f-ef6924726290 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:27.036409 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5d7885a0-626e-4f7d-a97f-ef6924726290 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:27.036926 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5d7885a0-626e-4f7d-a97f-ef6924726290 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:27.037370 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5d7885a0-626e-4f7d-a97f-ef6924726290 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:27.038056 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5d7885a0-626e-4f7d-a97f-ef6924726290 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:27.038508 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5d7885a0-626e-4f7d-a97f-ef6924726290 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:27.038951 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5d7885a0-626e-4f7d-a97f-ef6924726290 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:27.196923 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-5d7885a0-626e-4f7d-a97f-ef6924726290 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:27.205187 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-5d7885a0-626e-4f7d-a97f-ef6924726290 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e" status: 200 len: 1684 microversion: 2.1 time: 0.181664 Sep 06 01:15:27.213894 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 336/652] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:27 2022] GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e => generated 1684 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:28.230193 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-97c950c0-b236-4e20-948d-5b0a6e29498d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:28.230889 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-97c950c0-b236-4e20-948d-5b0a6e29498d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:28.237268 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97c950c0-b236-4e20-948d-5b0a6e29498d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:28.237749 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97c950c0-b236-4e20-948d-5b0a6e29498d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:28.238183 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97c950c0-b236-4e20-948d-5b0a6e29498d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:28.239369 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97c950c0-b236-4e20-948d-5b0a6e29498d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:28.239840 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97c950c0-b236-4e20-948d-5b0a6e29498d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:28.240263 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97c950c0-b236-4e20-948d-5b0a6e29498d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:28.259911 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:15:28.374674 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-97c950c0-b236-4e20-948d-5b0a6e29498d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:28.382320 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-97c950c0-b236-4e20-948d-5b0a6e29498d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e" status: 200 len: 1684 microversion: 2.1 time: 0.156371 Sep 06 01:15:28.382871 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 317/653] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:28 2022] GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:29.405327 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-b9712bbe-011a-491c-9701-a505401810ff tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:29.405942 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-b9712bbe-011a-491c-9701-a505401810ff tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:29.412846 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b9712bbe-011a-491c-9701-a505401810ff tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:29.413323 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b9712bbe-011a-491c-9701-a505401810ff tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:29.413759 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b9712bbe-011a-491c-9701-a505401810ff tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:29.414442 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b9712bbe-011a-491c-9701-a505401810ff tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:29.414894 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b9712bbe-011a-491c-9701-a505401810ff tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:29.415314 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b9712bbe-011a-491c-9701-a505401810ff tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:29.544539 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-b9712bbe-011a-491c-9701-a505401810ff tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:29.552067 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-b9712bbe-011a-491c-9701-a505401810ff tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e" status: 200 len: 1684 microversion: 2.1 time: 0.150516 Sep 06 01:15:29.552642 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 337/654] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:29 2022] GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:30.574898 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d7a440df-1d9f-46f6-8b76-0e9e3dc23d80 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:30.590532 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d7a440df-1d9f-46f6-8b76-0e9e3dc23d80 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:30.597812 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d7a440df-1d9f-46f6-8b76-0e9e3dc23d80 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:30.598634 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d7a440df-1d9f-46f6-8b76-0e9e3dc23d80 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:30.599321 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d7a440df-1d9f-46f6-8b76-0e9e3dc23d80 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:30.600109 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d7a440df-1d9f-46f6-8b76-0e9e3dc23d80 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:30.600528 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d7a440df-1d9f-46f6-8b76-0e9e3dc23d80 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:30.601137 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d7a440df-1d9f-46f6-8b76-0e9e3dc23d80 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:30.734293 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-d7a440df-1d9f-46f6-8b76-0e9e3dc23d80 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:30.741871 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d7a440df-1d9f-46f6-8b76-0e9e3dc23d80 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e" status: 200 len: 1684 microversion: 2.1 time: 0.170861 Sep 06 01:15:30.742426 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 318/655] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:30 2022] GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e => generated 1684 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:31.764794 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-faf8860a-0f82-4929-9a37-48d7187f9710 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:31.765397 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-faf8860a-0f82-4929-9a37-48d7187f9710 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:31.768094 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell0:SELECT=2 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:15:31.774062 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-faf8860a-0f82-4929-9a37-48d7187f9710 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:31.774536 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-faf8860a-0f82-4929-9a37-48d7187f9710 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:31.774962 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-faf8860a-0f82-4929-9a37-48d7187f9710 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:31.775644 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-faf8860a-0f82-4929-9a37-48d7187f9710 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:31.776122 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-faf8860a-0f82-4929-9a37-48d7187f9710 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:31.776542 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-faf8860a-0f82-4929-9a37-48d7187f9710 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:31.838217 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-faf8860a-0f82-4929-9a37-48d7187f9710 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:31.850269 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-faf8860a-0f82-4929-9a37-48d7187f9710 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e" status: 200 len: 1616 microversion: 2.1 time: 0.089029 Sep 06 01:15:31.851092 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 338/656] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:31 2022] GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e => generated 1616 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:32.003786 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-8e1803ab-f196-4046-a45b-7beb0daa003e req-0be5e80a-8e99-4056-afa9-bf6510d362be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e", "name": "network-vif-deleted", "tag": "cfd96f2a-f172-4913-9442-dad937b6c973"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:15:32.016352 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8e1803ab-f196-4046-a45b-7beb0daa003e req-0be5e80a-8e99-4056-afa9-bf6510d362be service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:32.016825 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8e1803ab-f196-4046-a45b-7beb0daa003e req-0be5e80a-8e99-4056-afa9-bf6510d362be service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:32.017449 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8e1803ab-f196-4046-a45b-7beb0daa003e req-0be5e80a-8e99-4056-afa9-bf6510d362be service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:32.030243 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-8e1803ab-f196-4046-a45b-7beb0daa003e req-0be5e80a-8e99-4056-afa9-bf6510d362be service nova] Creating event network-vif-deleted:cfd96f2a-f172-4913-9442-dad937b6c973 for instance b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e on hv-cinder-84773 Sep 06 01:15:32.035980 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-8e1803ab-f196-4046-a45b-7beb0daa003e req-0be5e80a-8e99-4056-afa9-bf6510d362be service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035260 Sep 06 01:15:32.036580 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 319/657] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:15:32.874433 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-819b7ea6-4a9d-4198-b412-35a64f48bbfb tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:32.875063 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-819b7ea6-4a9d-4198-b412-35a64f48bbfb tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:32.881665 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-819b7ea6-4a9d-4198-b412-35a64f48bbfb tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:32.882093 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-819b7ea6-4a9d-4198-b412-35a64f48bbfb tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:32.882527 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-819b7ea6-4a9d-4198-b412-35a64f48bbfb tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:32.883231 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-819b7ea6-4a9d-4198-b412-35a64f48bbfb tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:32.883684 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-819b7ea6-4a9d-4198-b412-35a64f48bbfb tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:32.884149 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-819b7ea6-4a9d-4198-b412-35a64f48bbfb tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:32.897450 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.wsgi [None req-819b7ea6-4a9d-4198-b412-35a64f48bbfb tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] HTTP exception thrown: Instance b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e could not be found. Sep 06 01:15:32.899204 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-819b7ea6-4a9d-4198-b412-35a64f48bbfb tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Request method failure captured: Sep 06 01:15:32.899204 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: request: GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e HTTP/1.1 Sep 06 01:15:32.899204 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept: application/json Sep 06 01:15:32.899204 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept-Encoding: identity Sep 06 01:15:32.899204 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Connection: close Sep 06 01:15:32.899204 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Length: 0 Sep 06 01:15:32.899204 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Type: application/json Sep 06 01:15:32.899204 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Host: 10.222.0.23 Sep 06 01:15:32.899204 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Openstack-System-Scope: None Sep 06 01:15:32.899204 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: User-Agent: python-urllib3/1.26.12 Sep 06 01:15:32.899204 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Auth-Token: gAAAAABjFp5HgEJZI7pOCAbhWXwWFE8yQ5t7K_Ws-jshDHbF7sXnYLPl16IIONgrpvYxWiZSDSAeitprugb5h17_eYSiBNUfLgmC9hbcnAOoP7NTvslLSb0CTURVLZpiFrwKL1VvcCbnqL_bQbP7LRSB17fvFEoXQ1dcjQQQPX7LNrOn0pG4F5A Sep 06 01:15:32.899204 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Id: None Sep 06 01:15:32.899204 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Name: None Sep 06 01:15:32.899204 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Identity-Status: Confirmed Sep 06 01:15:32.899204 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Is-Admin-Project: True Sep 06 01:15:32.899204 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Id: default Sep 06 01:15:32.899204 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Name: Default Sep 06 01:15:32.899204 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Id: 1fa73b0bfee14a9ea25f03e523078995 Sep 06 01:15:32.899204 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Name: tempest-AttachVolumeNegativeTest-1412452604 Sep 06 01:15:32.899204 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Role: reader,member Sep 06 01:15:32.899204 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Roles: reader,member Sep 06 01:15:32.900782 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1fa73b0bfee14a9ea25f03e523078995"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1fa73b0bfee14a9ea25f03e523078995"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1fa73b0bfee14a9ea25f03e523078995"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1fa73b0bfee14a9ea25f03e523078995"}]}] Sep 06 01:15:32.900782 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant: tempest-AttachVolumeNegativeTest-1412452604 Sep 06 01:15:32.900782 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Id: 1fa73b0bfee14a9ea25f03e523078995 Sep 06 01:15:32.900782 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1412452604 Sep 06 01:15:32.900782 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User: tempest-AttachVolumeNegativeTest-1412452604-project Sep 06 01:15:32.900782 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Id: default Sep 06 01:15:32.900782 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Name: Default Sep 06 01:15:32.900782 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Id: f8f44df824414e5ebc8cfd2126e9d66f Sep 06 01:15:32.900782 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Name: tempest-AttachVolumeNegativeTest-1412452604-project Sep 06 01:15:32.900782 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: method: > Sep 06 01:15:32.900782 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: exception: Instance b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e could not be found. Sep 06 01:15:32.900782 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: action_args: {'id': 'b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e'} Sep 06 01:15:32.901561 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:15:32.901561 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:15:32.901561 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 01:15:32.901561 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 01:15:32.901561 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 01:15:32.901561 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 01:15:32.901561 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 01:15:32.901561 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 01:15:32.901561 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 01:15:32.901561 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 01:15:32.901561 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e could not be found. Sep 06 01:15:32.901561 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:15:32.901561 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:15:32.901561 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:15:32.901561 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:15:32.901561 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:15:32.901561 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:15:32.901561 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:15:32.901561 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:15:32.901561 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:15:32.902941 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:15:32.902941 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 01:15:32.902941 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 01:15:32.902941 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 01:15:32.902941 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 01:15:32.902941 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 01:15:32.902941 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:15:32.902941 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e could not be found. Sep 06 01:15:32.902941 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:15:32.902941 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:15:32.902941 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:15:32.902941 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:15:32.902941 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:15:32.902941 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:15:32.902941 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:15:32.902941 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:15:32.902941 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e could not be found. Sep 06 01:15:32.902941 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:15:32.904441 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-819b7ea6-4a9d-4198-b412-35a64f48bbfb tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Returning 404 to user: Instance b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e could not be found. {{(pid=120580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:15:32.904441 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-819b7ea6-4a9d-4198-b412-35a64f48bbfb tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e" status: 404 len: 111 microversion: 2.1 time: 0.030590 Sep 06 01:15:32.904441 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 339/658] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:32 2022] GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 01:15:32.911285 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ebf423db-2e19-4b7e-81ca-5ca6fc7b9f92 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '.version_select at 0x7fb06e05e430>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:32.930898 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ebf423db-2e19-4b7e-81ca-5ca6fc7b9f92 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1187091458" status: 202 len: 0 microversion: 2.1 time: 0.024213 Sep 06 01:15:32.931516 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 320/659] 10.222.0.23 () {58 vars in 1221 bytes} [Tue Sep 6 01:15:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1187091458 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 01:15:33.557300 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-200f05dd-7750-4b5d-aa33-b2c91d7f751a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Action: 'create', calling method: .version_select at 0x7fb06e4c6790>, body: {"keypair": {"name": "tempest-keypair-540973257", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAn0QnIC8+r0SvqYEUOp7y7ZVkUMFlrnXPQ2jPoqnd1uHQXXKqYIDeBtvYZlfRTrcJukBNLsFvolsX3ujFYeLJi5wkaGAQtw5f6eDXqQCWb+USeOvXdzvWui1iGeTs5Fjw=="}} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:15:33.581717 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.quota [None req-200f05dd-7750-4b5d-aa33-b2c91d7f751a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Getting quotas for project 1fa73b0bfee14a9ea25f03e523078995. Resources: {'key_pairs'} {{(pid=120580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 01:15:33.586329 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.quota [None req-200f05dd-7750-4b5d-aa33-b2c91d7f751a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Getting quotas for user f8f44df824414e5ebc8cfd2126e9d66f and project 1fa73b0bfee14a9ea25f03e523078995. Resources: {'key_pairs'} {{(pid=120580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 01:15:33.609402 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-200f05dd-7750-4b5d-aa33-b2c91d7f751a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055892 Sep 06 01:15:33.610028 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 340/660] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Sep 6 01:15:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:15:34.789438 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dcb76493-57e0-45a0-877b-1d99c8e6919b tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:34.790213 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-dcb76493-57e0-45a0-877b-1d99c8e6919b tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 70d2092a-968f-45aa-a07c-ee3b6f1a918e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:34.806121 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dcb76493-57e0-45a0-877b-1d99c8e6919b tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:34.806609 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dcb76493-57e0-45a0-877b-1d99c8e6919b tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:34.807038 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dcb76493-57e0-45a0-877b-1d99c8e6919b tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:34.807729 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dcb76493-57e0-45a0-877b-1d99c8e6919b tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:34.808200 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dcb76493-57e0-45a0-877b-1d99c8e6919b tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:34.808619 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dcb76493-57e0-45a0-877b-1d99c8e6919b tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:34.872129 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-b171dae0-2832-43fe-8c59-df75c3e3f435 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1028253759", "imageRef": "768973cc-7b5f-4eed-b493-e40eb0de9f88", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d10b81f4-8ccb-48ae-aa86-1440cea903cc"}], "security_groups": [{"name": "tempest-securitygroup--554769925"}], "key_name": "tempest-keypair-540973257", "user_data": "}} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:15:34.942343 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-dcb76493-57e0-45a0-877b-1d99c8e6919b tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lazy-loading 'services' on Instance uuid 70d2092a-968f-45aa-a07c-ee3b6f1a918e {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 01:15:34.974755 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.network.neutron [None req-b171dae0-2832-43fe-8c59-df75c3e3f435 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] validate_networks() for [('d10b81f4-8ccb-48ae-aa86-1440cea903cc', None, None, None, None, None)] {{(pid=120580) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 01:15:35.061113 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dcb76493-57e0-45a0-877b-1d99c8e6919b tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "DELETE /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e/os-volume_attachments/f266c6ac-784f-4b4a-8a97-72db1e5e0737" status: 202 len: 0 microversion: 2.1 time: 0.275889 Sep 06 01:15:35.064773 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 321/661] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Sep 6 01:15:34 2022] DELETE /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e/os-volume_attachments/f266c6ac-784f-4b4a-8a97-72db1e5e0737 => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 01:15:35.359723 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-b171dae0-2832-43fe-8c59-df75c3e3f435 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Flavor limits 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 01:15:35.360188 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-b171dae0-2832-43fe-8c59-df75c3e3f435 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Image limits 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 01:15:35.360687 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-b171dae0-2832-43fe-8c59-df75c3e3f435 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Flavor pref 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 01:15:35.361094 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-b171dae0-2832-43fe-8c59-df75c3e3f435 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Image pref 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 01:15:35.361504 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-b171dae0-2832-43fe-8c59-df75c3e3f435 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 01:15:35.370748 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b171dae0-2832-43fe-8c59-df75c3e3f435 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:35.371226 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b171dae0-2832-43fe-8c59-df75c3e3f435 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:35.371660 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b171dae0-2832-43fe-8c59-df75c3e3f435 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:35.372412 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b171dae0-2832-43fe-8c59-df75c3e3f435 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:35.372863 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b171dae0-2832-43fe-8c59-df75c3e3f435 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:35.373288 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b171dae0-2832-43fe-8c59-df75c3e3f435 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:35.389298 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.quota [None req-b171dae0-2832-43fe-8c59-df75c3e3f435 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Getting quotas for project 1fa73b0bfee14a9ea25f03e523078995. Resources: {'instances', 'ram', 'cores'} {{(pid=120580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 01:15:35.393207 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.quota [None req-b171dae0-2832-43fe-8c59-df75c3e3f435 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Getting quotas for user f8f44df824414e5ebc8cfd2126e9d66f and project 1fa73b0bfee14a9ea25f03e523078995. Resources: {'instances', 'ram', 'cores'} {{(pid=120580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 01:15:35.403859 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-b171dae0-2832-43fe-8c59-df75c3e3f435 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Going to run 1 instances... {{(pid=120580) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 01:15:35.406097 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-b171dae0-2832-43fe-8c59-df75c3e3f435 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: a23ae8e0-f66b-46e1-a6fe-ac890b3efe45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='768973cc-7b5f-4eed-b493-e40eb0de9f88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 01:15:35.454137 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-b171dae0-2832-43fe-8c59-df75c3e3f435 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.586576 Sep 06 01:15:35.454776 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 341/662] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Sep 6 01:15:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 01:15:35.466690 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-45b97d4d-9381-4cb9-a736-56ef8e873d20 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:35.467468 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-45b97d4d-9381-4cb9-a736-56ef8e873d20 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: a23ae8e0-f66b-46e1-a6fe-ac890b3efe45] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:35.522084 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-45b97d4d-9381-4cb9-a736-56ef8e873d20 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:35.528770 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-45b97d4d-9381-4cb9-a736-56ef8e873d20 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45" status: 200 len: 1241 microversion: 2.1 time: 0.066209 Sep 06 01:15:35.529326 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 322/663] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:35 2022] GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:36.552380 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-81805c94-9e54-4543-9d25-49772dbb1da3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:36.552988 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-81805c94-9e54-4543-9d25-49772dbb1da3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: a23ae8e0-f66b-46e1-a6fe-ac890b3efe45] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:36.559969 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-81805c94-9e54-4543-9d25-49772dbb1da3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:36.560445 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-81805c94-9e54-4543-9d25-49772dbb1da3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:36.560876 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-81805c94-9e54-4543-9d25-49772dbb1da3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:36.561557 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-81805c94-9e54-4543-9d25-49772dbb1da3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:36.562014 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-81805c94-9e54-4543-9d25-49772dbb1da3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:36.562430 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-81805c94-9e54-4543-9d25-49772dbb1da3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:36.623461 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-81805c94-9e54-4543-9d25-49772dbb1da3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:36.631033 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-81805c94-9e54-4543-9d25-49772dbb1da3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45" status: 200 len: 1293 microversion: 2.1 time: 0.083127 Sep 06 01:15:36.631582 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 342/664] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:36 2022] GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:37.118705 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f5d41040-faf6-4da3-9ad5-06db45f39212 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:37.119404 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f5d41040-faf6-4da3-9ad5-06db45f39212 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:37.130472 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f5d41040-faf6-4da3-9ad5-06db45f39212 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:37.131331 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f5d41040-faf6-4da3-9ad5-06db45f39212 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:37.131868 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f5d41040-faf6-4da3-9ad5-06db45f39212 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:37.132643 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f5d41040-faf6-4da3-9ad5-06db45f39212 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:37.133175 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f5d41040-faf6-4da3-9ad5-06db45f39212 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:37.133674 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f5d41040-faf6-4da3-9ad5-06db45f39212 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:37.280015 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-f5d41040-faf6-4da3-9ad5-06db45f39212 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:37.288135 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f5d41040-faf6-4da3-9ad5-06db45f39212 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1595 microversion: 2.1 time: 0.173272 Sep 06 01:15:37.288693 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 323/665] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:37 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1595 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:37.654533 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-ca868560-22a3-4096-8a8b-80b78f4b7711 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:37.655120 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-ca868560-22a3-4096-8a8b-80b78f4b7711 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: a23ae8e0-f66b-46e1-a6fe-ac890b3efe45] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:37.662936 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ca868560-22a3-4096-8a8b-80b78f4b7711 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:37.663677 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ca868560-22a3-4096-8a8b-80b78f4b7711 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:37.664296 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ca868560-22a3-4096-8a8b-80b78f4b7711 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:37.665156 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ca868560-22a3-4096-8a8b-80b78f4b7711 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:37.665776 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ca868560-22a3-4096-8a8b-80b78f4b7711 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:37.666358 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ca868560-22a3-4096-8a8b-80b78f4b7711 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:37.753499 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-ca868560-22a3-4096-8a8b-80b78f4b7711 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:37.762212 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-ca868560-22a3-4096-8a8b-80b78f4b7711 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45" status: 200 len: 1311 microversion: 2.1 time: 0.111920 Sep 06 01:15:37.763164 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 343/666] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:37 2022] GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 => generated 1311 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:38.319224 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b529e60e-4d2d-48d9-8b21-5bac42e1ed07 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:38.319721 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b529e60e-4d2d-48d9-8b21-5bac42e1ed07 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 70d2092a-968f-45aa-a07c-ee3b6f1a918e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:38.326587 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b529e60e-4d2d-48d9-8b21-5bac42e1ed07 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:38.327138 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b529e60e-4d2d-48d9-8b21-5bac42e1ed07 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:38.327653 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b529e60e-4d2d-48d9-8b21-5bac42e1ed07 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:38.328382 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b529e60e-4d2d-48d9-8b21-5bac42e1ed07 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:38.328842 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b529e60e-4d2d-48d9-8b21-5bac42e1ed07 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:38.329270 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b529e60e-4d2d-48d9-8b21-5bac42e1ed07 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:38.357363 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b529e60e-4d2d-48d9-8b21-5bac42e1ed07 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 70d2092a-968f-45aa-a07c-ee3b6f1a918e] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 01:15:38.462541 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b529e60e-4d2d-48d9-8b21-5bac42e1ed07 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "DELETE /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e" status: 204 len: 0 microversion: 2.1 time: 0.146491 Sep 06 01:15:38.463549 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 324/667] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 6 01:15:38 2022] DELETE /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 01:15:38.475585 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-178905f8-c76e-462a-a9a0-54bed7438673 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:38.476906 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-178905f8-c76e-462a-a9a0-54bed7438673 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 70d2092a-968f-45aa-a07c-ee3b6f1a918e] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:38.483488 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-178905f8-c76e-462a-a9a0-54bed7438673 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:38.484829 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-178905f8-c76e-462a-a9a0-54bed7438673 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:38.485593 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-178905f8-c76e-462a-a9a0-54bed7438673 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:38.486305 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-178905f8-c76e-462a-a9a0-54bed7438673 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:38.486750 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-178905f8-c76e-462a-a9a0-54bed7438673 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:38.487362 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-178905f8-c76e-462a-a9a0-54bed7438673 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:38.493950 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:15:38.723556 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-178905f8-c76e-462a-a9a0-54bed7438673 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:38.732211 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-178905f8-c76e-462a-a9a0-54bed7438673 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e" status: 200 len: 1513 microversion: 2.1 time: 0.263670 Sep 06 01:15:38.732780 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 344/668] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:38 2022] GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e => generated 1513 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:38.789402 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6a774926-befd-4640-9e06-08a5b140779f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:38.789627 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6a774926-befd-4640-9e06-08a5b140779f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: a23ae8e0-f66b-46e1-a6fe-ac890b3efe45] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:38.795527 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6a774926-befd-4640-9e06-08a5b140779f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:38.796248 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6a774926-befd-4640-9e06-08a5b140779f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:38.796876 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6a774926-befd-4640-9e06-08a5b140779f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:38.797578 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6a774926-befd-4640-9e06-08a5b140779f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:38.798258 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6a774926-befd-4640-9e06-08a5b140779f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:38.798859 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6a774926-befd-4640-9e06-08a5b140779f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:39.169860 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-6eeaf838-4e6c-4bf0-a694-9d81d81dcca5 req-2342d7e9-b3cd-44a1-b1ab-f4d3e09906a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a23ae8e0-f66b-46e1-a6fe-ac890b3efe45", "tag": "90ca3270-3768-4e11-aa21-10a962ec5f79"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:15:39.180018 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-6eeaf838-4e6c-4bf0-a694-9d81d81dcca5 req-2342d7e9-b3cd-44a1-b1ab-f4d3e09906a0 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:39.180499 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-6eeaf838-4e6c-4bf0-a694-9d81d81dcca5 req-2342d7e9-b3cd-44a1-b1ab-f4d3e09906a0 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:39.181115 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-6eeaf838-4e6c-4bf0-a694-9d81d81dcca5 req-2342d7e9-b3cd-44a1-b1ab-f4d3e09906a0 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:39.193916 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.compute.server_external_events [req-6eeaf838-4e6c-4bf0-a694-9d81d81dcca5 req-2342d7e9-b3cd-44a1-b1ab-f4d3e09906a0 service nova] Creating event network-changed:90ca3270-3768-4e11-aa21-10a962ec5f79 for instance a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 on hv-cinder-84773 Sep 06 01:15:39.199723 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [req-6eeaf838-4e6c-4bf0-a694-9d81d81dcca5 req-2342d7e9-b3cd-44a1-b1ab-f4d3e09906a0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033983 Sep 06 01:15:39.200890 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 345/669] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 01:15:39.243424 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-6a774926-befd-4640-9e06-08a5b140779f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:39.253390 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6a774926-befd-4640-9e06-08a5b140779f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45" status: 200 len: 1366 microversion: 2.1 time: 0.469887 Sep 06 01:15:39.255287 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 325/670] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:38 2022] GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 => generated 1366 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:39.524442 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-d793aa43-f05d-443b-8658-97cb89488348 req-33bda565-b366-4369-8fb3-f43fd023ad38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "590890af-37ec-4cde-b2f7-0b20cc31b43d", "tag": "c382089c-3c7e-40e3-825b-3469de858075"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:15:39.534130 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-d793aa43-f05d-443b-8658-97cb89488348 req-33bda565-b366-4369-8fb3-f43fd023ad38 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:39.534896 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-d793aa43-f05d-443b-8658-97cb89488348 req-33bda565-b366-4369-8fb3-f43fd023ad38 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:39.535420 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-d793aa43-f05d-443b-8658-97cb89488348 req-33bda565-b366-4369-8fb3-f43fd023ad38 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:39.549404 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.compute.server_external_events [req-d793aa43-f05d-443b-8658-97cb89488348 req-33bda565-b366-4369-8fb3-f43fd023ad38 service nova] Creating event network-changed:c382089c-3c7e-40e3-825b-3469de858075 for instance 590890af-37ec-4cde-b2f7-0b20cc31b43d on hv-cinder-84773 Sep 06 01:15:39.555138 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [req-d793aa43-f05d-443b-8658-97cb89488348 req-33bda565-b366-4369-8fb3-f43fd023ad38 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034531 Sep 06 01:15:39.555740 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 346/671] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:15:39.755791 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8c2850c9-aaec-4720-ae60-8bd2bf3f6caf tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:39.757008 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8c2850c9-aaec-4720-ae60-8bd2bf3f6caf tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 70d2092a-968f-45aa-a07c-ee3b6f1a918e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:39.763915 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c2850c9-aaec-4720-ae60-8bd2bf3f6caf tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:39.764332 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c2850c9-aaec-4720-ae60-8bd2bf3f6caf tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:39.764764 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c2850c9-aaec-4720-ae60-8bd2bf3f6caf tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:39.765633 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c2850c9-aaec-4720-ae60-8bd2bf3f6caf tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:39.766260 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c2850c9-aaec-4720-ae60-8bd2bf3f6caf tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:39.766680 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c2850c9-aaec-4720-ae60-8bd2bf3f6caf tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:39.959947 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-8c2850c9-aaec-4720-ae60-8bd2bf3f6caf tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:39.968474 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8c2850c9-aaec-4720-ae60-8bd2bf3f6caf tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e" status: 200 len: 1513 microversion: 2.1 time: 0.216934 Sep 06 01:15:39.976631 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 326/672] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:39 2022] GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e => generated 1513 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:40.282638 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-3102fca7-7fbd-417e-8c1e-46d47d06d207 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:40.284306 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-3102fca7-7fbd-417e-8c1e-46d47d06d207 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: a23ae8e0-f66b-46e1-a6fe-ac890b3efe45] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:40.294480 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3102fca7-7fbd-417e-8c1e-46d47d06d207 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:40.295867 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3102fca7-7fbd-417e-8c1e-46d47d06d207 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:40.296532 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3102fca7-7fbd-417e-8c1e-46d47d06d207 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:40.298838 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3102fca7-7fbd-417e-8c1e-46d47d06d207 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:40.299623 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3102fca7-7fbd-417e-8c1e-46d47d06d207 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:40.302110 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3102fca7-7fbd-417e-8c1e-46d47d06d207 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:40.552128 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-3102fca7-7fbd-417e-8c1e-46d47d06d207 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:40.562561 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-3102fca7-7fbd-417e-8c1e-46d47d06d207 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45" status: 200 len: 1366 microversion: 2.1 time: 0.284667 Sep 06 01:15:40.563413 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 347/673] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:40 2022] GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:40.733534 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-961ca23c-87ae-4ee7-8182-8a4ccd35543c tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-896786906"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:15:40.734120 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-961ca23c-87ae-4ee7-8182-8a4ccd35543c tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:40.747499 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-961ca23c-87ae-4ee7-8182-8a4ccd35543c tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:40.752116 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-961ca23c-87ae-4ee7-8182-8a4ccd35543c tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:40.752615 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-961ca23c-87ae-4ee7-8182-8a4ccd35543c tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:40.753361 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-961ca23c-87ae-4ee7-8182-8a4ccd35543c tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:40.754460 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-961ca23c-87ae-4ee7-8182-8a4ccd35543c tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:40.754893 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-961ca23c-87ae-4ee7-8182-8a4ccd35543c tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:40.994412 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-43b06da3-2b51-4b60-9997-be330050dd53 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:40.995323 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-43b06da3-2b51-4b60-9997-be330050dd53 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 70d2092a-968f-45aa-a07c-ee3b6f1a918e] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:40.997280 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:15:41.002385 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-43b06da3-2b51-4b60-9997-be330050dd53 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:41.002863 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-43b06da3-2b51-4b60-9997-be330050dd53 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:41.003467 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-43b06da3-2b51-4b60-9997-be330050dd53 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:41.004373 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-43b06da3-2b51-4b60-9997-be330050dd53 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:41.004818 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-43b06da3-2b51-4b60-9997-be330050dd53 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:41.005418 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-43b06da3-2b51-4b60-9997-be330050dd53 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:41.029948 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.network.security_group_api [None req-961ca23c-87ae-4ee7-8182-8a4ccd35543c tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Adding security group 8dd9b9fb-bcd4-4fed-b566-b46e843aff05 to port c382089c-3c7e-40e3-825b-3469de858075 Sep 06 01:15:41.320139 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-43b06da3-2b51-4b60-9997-be330050dd53 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:41.330237 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-43b06da3-2b51-4b60-9997-be330050dd53 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e" status: 200 len: 1513 microversion: 2.1 time: 0.339843 Sep 06 01:15:41.330885 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 348/674] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:40 2022] GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e => generated 1513 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:41.574291 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-5cb4efc7-e953-400e-8ea5-c8131d166ed5 req-cd2e7bc8-bbbe-4cb1-8d45-19d74403009a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70d2092a-968f-45aa-a07c-ee3b6f1a918e", "name": "network-vif-deleted", "tag": "4b2f4d5d-3bb2-4d5b-8556-4b9eb01d4509"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:15:41.586934 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-5cb4efc7-e953-400e-8ea5-c8131d166ed5 req-cd2e7bc8-bbbe-4cb1-8d45-19d74403009a service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:41.587515 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-5cb4efc7-e953-400e-8ea5-c8131d166ed5 req-cd2e7bc8-bbbe-4cb1-8d45-19d74403009a service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:41.588070 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-5cb4efc7-e953-400e-8ea5-c8131d166ed5 req-cd2e7bc8-bbbe-4cb1-8d45-19d74403009a service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:41.600181 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.compute.server_external_events [req-5cb4efc7-e953-400e-8ea5-c8131d166ed5 req-cd2e7bc8-bbbe-4cb1-8d45-19d74403009a service nova] Creating event network-vif-deleted:4b2f4d5d-3bb2-4d5b-8556-4b9eb01d4509 for instance 70d2092a-968f-45aa-a07c-ee3b6f1a918e on hv-cinder-84773 Sep 06 01:15:41.606885 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [req-5cb4efc7-e953-400e-8ea5-c8131d166ed5 req-cd2e7bc8-bbbe-4cb1-8d45-19d74403009a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036213 Sep 06 01:15:41.607484 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 349/675] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:15:41.612631 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-a0d9d6f6-320f-4b0d-b01f-4867de6b4ab5 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:41.613825 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-a0d9d6f6-320f-4b0d-b01f-4867de6b4ab5 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: a23ae8e0-f66b-46e1-a6fe-ac890b3efe45] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:41.621260 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a0d9d6f6-320f-4b0d-b01f-4867de6b4ab5 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:41.622025 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a0d9d6f6-320f-4b0d-b01f-4867de6b4ab5 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:41.622625 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a0d9d6f6-320f-4b0d-b01f-4867de6b4ab5 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:41.624177 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a0d9d6f6-320f-4b0d-b01f-4867de6b4ab5 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:41.624789 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a0d9d6f6-320f-4b0d-b01f-4867de6b4ab5 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:41.625424 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a0d9d6f6-320f-4b0d-b01f-4867de6b4ab5 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:41.679530 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-961ca23c-87ae-4ee7-8182-8a4ccd35543c tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "POST /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d/action" status: 202 len: 0 microversion: 2.1 time: 0.952628 Sep 06 01:15:41.680953 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 327/676] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Sep 6 01:15:40 2022] POST /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d/action => generated 0 bytes in 955 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 01:15:41.692552 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6b7639ca-cbcc-4449-b2cc-677c0ded5fb6 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:41.693519 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6b7639ca-cbcc-4449-b2cc-677c0ded5fb6 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:41.701202 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b7639ca-cbcc-4449-b2cc-677c0ded5fb6 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:41.703141 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b7639ca-cbcc-4449-b2cc-677c0ded5fb6 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:41.704398 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b7639ca-cbcc-4449-b2cc-677c0ded5fb6 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:41.705455 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b7639ca-cbcc-4449-b2cc-677c0ded5fb6 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:41.706138 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b7639ca-cbcc-4449-b2cc-677c0ded5fb6 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:41.707468 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b7639ca-cbcc-4449-b2cc-677c0ded5fb6 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:41.890290 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-a0d9d6f6-320f-4b0d-b01f-4867de6b4ab5 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:41.901190 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-a0d9d6f6-320f-4b0d-b01f-4867de6b4ab5 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45" status: 200 len: 1366 microversion: 2.1 time: 0.292261 Sep 06 01:15:41.918886 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 350/677] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:41 2022] GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 => generated 1366 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:41.974446 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-6b7639ca-cbcc-4449-b2cc-677c0ded5fb6 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:41.987106 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6b7639ca-cbcc-4449-b2cc-677c0ded5fb6 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1641 microversion: 2.1 time: 0.301832 Sep 06 01:15:41.993582 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 328/678] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:41 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1641 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:42.354637 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-d84c4ecc-8927-4ea5-b885-4550049bee06 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:42.355248 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-d84c4ecc-8927-4ea5-b885-4550049bee06 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 70d2092a-968f-45aa-a07c-ee3b6f1a918e] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:42.361684 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d84c4ecc-8927-4ea5-b885-4550049bee06 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:42.362163 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d84c4ecc-8927-4ea5-b885-4550049bee06 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:42.362597 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d84c4ecc-8927-4ea5-b885-4550049bee06 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:42.363310 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d84c4ecc-8927-4ea5-b885-4550049bee06 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:42.363775 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d84c4ecc-8927-4ea5-b885-4550049bee06 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:42.364197 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d84c4ecc-8927-4ea5-b885-4550049bee06 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:42.393994 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d84c4ecc-8927-4ea5-b885-4550049bee06 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:42.394960 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d84c4ecc-8927-4ea5-b885-4550049bee06 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:42.395388 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d84c4ecc-8927-4ea5-b885-4550049bee06 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:42.395871 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.objects.instance [None req-d84c4ecc-8927-4ea5-b885-4550049bee06 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lazy-loading 'fault' on Instance uuid 70d2092a-968f-45aa-a07c-ee3b6f1a918e {{(pid=120580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 01:15:42.438198 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-d84c4ecc-8927-4ea5-b885-4550049bee06 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:42.445931 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-d84c4ecc-8927-4ea5-b885-4550049bee06 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e" status: 200 len: 1308 microversion: 2.1 time: 0.095110 Sep 06 01:15:42.446665 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 351/679] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:42 2022] GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:42.925970 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-453a855b-aa53-43f8-953f-c3401c9a75e2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:42.926574 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-453a855b-aa53-43f8-953f-c3401c9a75e2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: a23ae8e0-f66b-46e1-a6fe-ac890b3efe45] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:42.932914 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-453a855b-aa53-43f8-953f-c3401c9a75e2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:42.933389 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-453a855b-aa53-43f8-953f-c3401c9a75e2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:42.933814 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-453a855b-aa53-43f8-953f-c3401c9a75e2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:42.934491 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-453a855b-aa53-43f8-953f-c3401c9a75e2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:42.934937 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-453a855b-aa53-43f8-953f-c3401c9a75e2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:42.935352 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-453a855b-aa53-43f8-953f-c3401c9a75e2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:43.063427 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-453a855b-aa53-43f8-953f-c3401c9a75e2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:43.071526 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-453a855b-aa53-43f8-953f-c3401c9a75e2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45" status: 200 len: 1366 microversion: 2.1 time: 0.149404 Sep 06 01:15:43.072115 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 329/680] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:42 2022] GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:43.469260 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-720fb0cb-b726-46ac-98ed-a24fffaff41c tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:43.469869 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-720fb0cb-b726-46ac-98ed-a24fffaff41c tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 70d2092a-968f-45aa-a07c-ee3b6f1a918e] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:43.476696 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-720fb0cb-b726-46ac-98ed-a24fffaff41c tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:43.477173 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-720fb0cb-b726-46ac-98ed-a24fffaff41c tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:43.477608 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-720fb0cb-b726-46ac-98ed-a24fffaff41c tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:43.478288 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-720fb0cb-b726-46ac-98ed-a24fffaff41c tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:43.478738 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-720fb0cb-b726-46ac-98ed-a24fffaff41c tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:43.479158 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-720fb0cb-b726-46ac-98ed-a24fffaff41c tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:43.509144 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-720fb0cb-b726-46ac-98ed-a24fffaff41c tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:43.509549 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-720fb0cb-b726-46ac-98ed-a24fffaff41c tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:43.509983 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-720fb0cb-b726-46ac-98ed-a24fffaff41c tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:43.510428 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.objects.instance [None req-720fb0cb-b726-46ac-98ed-a24fffaff41c tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lazy-loading 'fault' on Instance uuid 70d2092a-968f-45aa-a07c-ee3b6f1a918e {{(pid=120580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 01:15:43.551834 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-720fb0cb-b726-46ac-98ed-a24fffaff41c tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2b7b4cb4a34964a4d6127a1ed3ac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d649e0b0434716b8d4aaf4ea171a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:43.559321 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-720fb0cb-b726-46ac-98ed-a24fffaff41c tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e" status: 200 len: 1308 microversion: 2.1 time: 0.093907 Sep 06 01:15:43.559897 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 352/681] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:43 2022] GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e => generated 1308 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:43.663986 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-403611ef-d63e-401c-8c09-7f8d8b3b7d9f req-654a695d-4f1f-49cc-9301-376dd0b62d1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "590890af-37ec-4cde-b2f7-0b20cc31b43d", "tag": "c382089c-3c7e-40e3-825b-3469de858075"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:15:43.675120 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-403611ef-d63e-401c-8c09-7f8d8b3b7d9f req-654a695d-4f1f-49cc-9301-376dd0b62d1c service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:43.677285 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-403611ef-d63e-401c-8c09-7f8d8b3b7d9f req-654a695d-4f1f-49cc-9301-376dd0b62d1c service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:43.677722 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-403611ef-d63e-401c-8c09-7f8d8b3b7d9f req-654a695d-4f1f-49cc-9301-376dd0b62d1c service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:43.690043 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-403611ef-d63e-401c-8c09-7f8d8b3b7d9f req-654a695d-4f1f-49cc-9301-376dd0b62d1c service nova] Creating event network-changed:c382089c-3c7e-40e3-825b-3469de858075 for instance 590890af-37ec-4cde-b2f7-0b20cc31b43d on hv-cinder-84773 Sep 06 01:15:43.694756 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-403611ef-d63e-401c-8c09-7f8d8b3b7d9f req-654a695d-4f1f-49cc-9301-376dd0b62d1c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035273 Sep 06 01:15:43.695355 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 330/682] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:15:44.093721 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-8de1314d-6680-4d36-bf26-00578591832c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:44.094405 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-8de1314d-6680-4d36-bf26-00578591832c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: a23ae8e0-f66b-46e1-a6fe-ac890b3efe45] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:44.100872 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8de1314d-6680-4d36-bf26-00578591832c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:44.101600 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8de1314d-6680-4d36-bf26-00578591832c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:44.102006 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8de1314d-6680-4d36-bf26-00578591832c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:44.102920 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8de1314d-6680-4d36-bf26-00578591832c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:44.103320 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8de1314d-6680-4d36-bf26-00578591832c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:44.103970 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8de1314d-6680-4d36-bf26-00578591832c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:44.255653 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-8de1314d-6680-4d36-bf26-00578591832c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:44.264115 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-8de1314d-6680-4d36-bf26-00578591832c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45" status: 200 len: 1366 microversion: 2.1 time: 0.174020 Sep 06 01:15:44.264987 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 353/683] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:44 2022] GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:44.583889 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f86d69c1-a7e8-4881-875c-81029abd4df4 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:44.585400 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f86d69c1-a7e8-4881-875c-81029abd4df4 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] [instance: 70d2092a-968f-45aa-a07c-ee3b6f1a918e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:44.593378 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f86d69c1-a7e8-4881-875c-81029abd4df4 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:44.593802 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f86d69c1-a7e8-4881-875c-81029abd4df4 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:44.594412 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f86d69c1-a7e8-4881-875c-81029abd4df4 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:44.595102 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f86d69c1-a7e8-4881-875c-81029abd4df4 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:44.595726 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f86d69c1-a7e8-4881-875c-81029abd4df4 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:44.596240 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f86d69c1-a7e8-4881-875c-81029abd4df4 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:44.609836 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-f86d69c1-a7e8-4881-875c-81029abd4df4 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] HTTP exception thrown: Instance 70d2092a-968f-45aa-a07c-ee3b6f1a918e could not be found. Sep 06 01:15:44.611476 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f86d69c1-a7e8-4881-875c-81029abd4df4 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Request method failure captured: Sep 06 01:15:44.611476 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e HTTP/1.1 Sep 06 01:15:44.611476 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept: application/json Sep 06 01:15:44.611476 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept-Encoding: identity Sep 06 01:15:44.611476 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Connection: close Sep 06 01:15:44.611476 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Length: 0 Sep 06 01:15:44.611476 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Type: application/json Sep 06 01:15:44.611476 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Host: 10.222.0.23 Sep 06 01:15:44.611476 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Openstack-System-Scope: None Sep 06 01:15:44.611476 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Sep 06 01:15:44.611476 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjFp5_S3ywqzVFLiOP_itLFSEGJZ7PtWCJjZCqJxzQc2BQO9SO2bKdXqIYrvPltuS1-NKKC38wB2c5qspESAwp9QoeTLdeSn26zq3nVL7uvB6EN7cayaD-4VccaXE7mWPNbCzv4KnNcNWge4a3md5dJxMQq4WV43Ai6DRsQOJdqb8grJY Sep 06 01:15:44.611476 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Id: None Sep 06 01:15:44.611476 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Name: None Sep 06 01:15:44.611476 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Identity-Status: Confirmed Sep 06 01:15:44.611476 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Is-Admin-Project: True Sep 06 01:15:44.611476 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Id: default Sep 06 01:15:44.611476 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Name: Default Sep 06 01:15:44.611476 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Id: d4d649e0b0434716b8d4aaf4ea171a8e Sep 06 01:15:44.611476 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1968721303 Sep 06 01:15:44.611476 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Role: reader,member Sep 06 01:15:44.611476 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Roles: reader,member Sep 06 01:15:44.613513 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d4d649e0b0434716b8d4aaf4ea171a8e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d4d649e0b0434716b8d4aaf4ea171a8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d4d649e0b0434716b8d4aaf4ea171a8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d4d649e0b0434716b8d4aaf4ea171a8e"}]}] Sep 06 01:15:44.613513 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant: tempest-VolumesSnapshotTestJSON-1968721303 Sep 06 01:15:44.613513 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Id: d4d649e0b0434716b8d4aaf4ea171a8e Sep 06 01:15:44.613513 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1968721303 Sep 06 01:15:44.613513 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User: tempest-VolumesSnapshotTestJSON-1968721303-project Sep 06 01:15:44.613513 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Id: default Sep 06 01:15:44.613513 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Name: Default Sep 06 01:15:44.613513 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Id: 2d2b7b4cb4a34964a4d6127a1ed3ac98 Sep 06 01:15:44.613513 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Name: tempest-VolumesSnapshotTestJSON-1968721303-project Sep 06 01:15:44.613513 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: method: > Sep 06 01:15:44.613513 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: exception: Instance 70d2092a-968f-45aa-a07c-ee3b6f1a918e could not be found. Sep 06 01:15:44.613513 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: action_args: {'id': '70d2092a-968f-45aa-a07c-ee3b6f1a918e'} Sep 06 01:15:44.614398 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:15:44.614398 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:15:44.614398 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 01:15:44.614398 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 01:15:44.614398 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 01:15:44.614398 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 01:15:44.614398 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 01:15:44.614398 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 01:15:44.614398 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 01:15:44.614398 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 01:15:44.614398 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70d2092a-968f-45aa-a07c-ee3b6f1a918e could not be found. Sep 06 01:15:44.614398 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:15:44.614398 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:15:44.614398 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:15:44.614398 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:15:44.614398 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:15:44.614398 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:15:44.614398 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:15:44.614398 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:15:44.614398 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:15:44.615837 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:15:44.615837 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 01:15:44.615837 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 01:15:44.615837 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 01:15:44.615837 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 01:15:44.615837 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 01:15:44.615837 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:15:44.615837 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70d2092a-968f-45aa-a07c-ee3b6f1a918e could not be found. Sep 06 01:15:44.615837 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:15:44.615837 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:15:44.615837 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:15:44.615837 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:15:44.615837 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:15:44.615837 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:15:44.615837 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:15:44.615837 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:15:44.615837 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70d2092a-968f-45aa-a07c-ee3b6f1a918e could not be found. Sep 06 01:15:44.615837 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:15:44.617002 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f86d69c1-a7e8-4881-875c-81029abd4df4 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] Returning 404 to user: Instance 70d2092a-968f-45aa-a07c-ee3b6f1a918e could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:15:44.617002 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f86d69c1-a7e8-4881-875c-81029abd4df4 tempest-VolumesSnapshotTestJSON-1968721303 tempest-VolumesSnapshotTestJSON-1968721303-project] 10.222.0.23 "GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e" status: 404 len: 111 microversion: 2.1 time: 0.034711 Sep 06 01:15:44.617002 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 331/684] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:44 2022] GET /compute/v2.1/servers/70d2092a-968f-45aa-a07c-ee3b6f1a918e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 01:15:45.287793 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-5f0806f1-2f0e-43b4-8938-59c1ea6c7612 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:45.288409 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-5f0806f1-2f0e-43b4-8938-59c1ea6c7612 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: a23ae8e0-f66b-46e1-a6fe-ac890b3efe45] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:45.294973 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5f0806f1-2f0e-43b4-8938-59c1ea6c7612 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:45.295451 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5f0806f1-2f0e-43b4-8938-59c1ea6c7612 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:45.295917 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5f0806f1-2f0e-43b4-8938-59c1ea6c7612 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:45.296613 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5f0806f1-2f0e-43b4-8938-59c1ea6c7612 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:45.297064 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5f0806f1-2f0e-43b4-8938-59c1ea6c7612 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:45.297519 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5f0806f1-2f0e-43b4-8938-59c1ea6c7612 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:45.380299 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell0:SELECT=2 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:15:45.399964 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell0:SELECT=10 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:15:45.424357 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-5f0806f1-2f0e-43b4-8938-59c1ea6c7612 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:45.431830 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-5f0806f1-2f0e-43b4-8938-59c1ea6c7612 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45" status: 200 len: 1366 microversion: 2.1 time: 0.148461 Sep 06 01:15:45.432401 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 354/685] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:45 2022] GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:46.356706 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-67268e75-b428-46c8-83cf-3f9a219c3d67 req-bef000aa-162c-4702-a27d-c0fb93aa1c81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a23ae8e0-f66b-46e1-a6fe-ac890b3efe45", "name": "network-vif-plugged", "status": "completed", "tag": "90ca3270-3768-4e11-aa21-10a962ec5f79"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:15:46.361670 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:15:46.368542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-67268e75-b428-46c8-83cf-3f9a219c3d67 req-bef000aa-162c-4702-a27d-c0fb93aa1c81 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:46.369015 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-67268e75-b428-46c8-83cf-3f9a219c3d67 req-bef000aa-162c-4702-a27d-c0fb93aa1c81 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:46.369445 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-67268e75-b428-46c8-83cf-3f9a219c3d67 req-bef000aa-162c-4702-a27d-c0fb93aa1c81 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:46.380474 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-67268e75-b428-46c8-83cf-3f9a219c3d67 req-bef000aa-162c-4702-a27d-c0fb93aa1c81 service nova] Creating event network-vif-plugged:90ca3270-3768-4e11-aa21-10a962ec5f79 for instance a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 on hv-cinder-84773 Sep 06 01:15:46.385210 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-67268e75-b428-46c8-83cf-3f9a219c3d67 req-bef000aa-162c-4702-a27d-c0fb93aa1c81 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032172 Sep 06 01:15:46.385785 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 332/686] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:15:46.454193 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-0ba70eb4-496d-4466-a622-35cde89205f4 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:46.454728 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-0ba70eb4-496d-4466-a622-35cde89205f4 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: a23ae8e0-f66b-46e1-a6fe-ac890b3efe45] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:46.461558 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0ba70eb4-496d-4466-a622-35cde89205f4 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:46.462037 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0ba70eb4-496d-4466-a622-35cde89205f4 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:46.462476 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0ba70eb4-496d-4466-a622-35cde89205f4 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:46.463161 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0ba70eb4-496d-4466-a622-35cde89205f4 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:46.463613 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0ba70eb4-496d-4466-a622-35cde89205f4 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:46.464066 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0ba70eb4-496d-4466-a622-35cde89205f4 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:46.599259 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-0ba70eb4-496d-4466-a622-35cde89205f4 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:46.606949 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-0ba70eb4-496d-4466-a622-35cde89205f4 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45" status: 200 len: 1366 microversion: 2.1 time: 0.156702 Sep 06 01:15:46.607516 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 355/687] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:46 2022] GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:46.846333 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b2cf2289-6fb5-4d5a-8da8-593d43370a0f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5c8d087-d284-4a06-9778-63333c2d17cd"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:15:46.849308 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b2cf2289-6fb5-4d5a-8da8-593d43370a0f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:46.855586 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b2cf2289-6fb5-4d5a-8da8-593d43370a0f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:46.856104 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b2cf2289-6fb5-4d5a-8da8-593d43370a0f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:46.856541 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b2cf2289-6fb5-4d5a-8da8-593d43370a0f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:46.857214 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b2cf2289-6fb5-4d5a-8da8-593d43370a0f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:46.857660 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b2cf2289-6fb5-4d5a-8da8-593d43370a0f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:46.858078 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b2cf2289-6fb5-4d5a-8da8-593d43370a0f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:47.630923 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-e12dd29b-312c-4752-aeb5-d4eff4a39fab tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:47.631541 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-e12dd29b-312c-4752-aeb5-d4eff4a39fab tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: a23ae8e0-f66b-46e1-a6fe-ac890b3efe45] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:47.637877 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e12dd29b-312c-4752-aeb5-d4eff4a39fab tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:47.638354 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e12dd29b-312c-4752-aeb5-d4eff4a39fab tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:47.638787 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e12dd29b-312c-4752-aeb5-d4eff4a39fab tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:47.639468 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e12dd29b-312c-4752-aeb5-d4eff4a39fab tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:47.639952 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e12dd29b-312c-4752-aeb5-d4eff4a39fab tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:47.640375 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e12dd29b-312c-4752-aeb5-d4eff4a39fab tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:47.767301 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-e12dd29b-312c-4752-aeb5-d4eff4a39fab tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:47.774805 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-e12dd29b-312c-4752-aeb5-d4eff4a39fab tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45" status: 200 len: 1366 microversion: 2.1 time: 0.148361 Sep 06 01:15:47.775355 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 356/688] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:47 2022] GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:15:48.797658 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-73964c28-26a4-4a1b-a8ca-298aa92d365d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:48.798286 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-73964c28-26a4-4a1b-a8ca-298aa92d365d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: a23ae8e0-f66b-46e1-a6fe-ac890b3efe45] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:48.804698 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-73964c28-26a4-4a1b-a8ca-298aa92d365d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:48.805206 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-73964c28-26a4-4a1b-a8ca-298aa92d365d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:48.805644 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-73964c28-26a4-4a1b-a8ca-298aa92d365d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:48.806325 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-73964c28-26a4-4a1b-a8ca-298aa92d365d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:48.806774 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-73964c28-26a4-4a1b-a8ca-298aa92d365d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:48.807195 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-73964c28-26a4-4a1b-a8ca-298aa92d365d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:48.948423 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-73964c28-26a4-4a1b-a8ca-298aa92d365d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:48.958460 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-73964c28-26a4-4a1b-a8ca-298aa92d365d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45" status: 200 len: 1366 microversion: 2.1 time: 0.164070 Sep 06 01:15:48.959415 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 357/689] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:48 2022] GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:15:49.084977 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b2cf2289-6fb5-4d5a-8da8-593d43370a0f tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "POST /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.242922 Sep 06 01:15:49.085893 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 333/690] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Sep 6 01:15:46 2022] POST /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088/os-volume_attachments => generated 194 bytes in 2245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 01:15:49.981841 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-3fd58f02-9a08-488c-9dea-b90bfd749b8d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:49.982562 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-3fd58f02-9a08-488c-9dea-b90bfd749b8d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: a23ae8e0-f66b-46e1-a6fe-ac890b3efe45] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:49.989059 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3fd58f02-9a08-488c-9dea-b90bfd749b8d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:49.989542 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3fd58f02-9a08-488c-9dea-b90bfd749b8d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:49.989976 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3fd58f02-9a08-488c-9dea-b90bfd749b8d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:49.990658 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3fd58f02-9a08-488c-9dea-b90bfd749b8d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:49.991108 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3fd58f02-9a08-488c-9dea-b90bfd749b8d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:49.991532 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3fd58f02-9a08-488c-9dea-b90bfd749b8d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:50.119897 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-3fd58f02-9a08-488c-9dea-b90bfd749b8d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:50.127917 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-3fd58f02-9a08-488c-9dea-b90bfd749b8d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45" status: 200 len: 1366 microversion: 2.1 time: 0.149763 Sep 06 01:15:50.139586 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 358/691] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:49 2022] GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:51.151220 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-541bc73e-37f5-4435-8e94-ddf5e3c480ca tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:51.151932 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-541bc73e-37f5-4435-8e94-ddf5e3c480ca tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: a23ae8e0-f66b-46e1-a6fe-ac890b3efe45] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:51.154233 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:15:51.161169 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-541bc73e-37f5-4435-8e94-ddf5e3c480ca tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:51.161721 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-541bc73e-37f5-4435-8e94-ddf5e3c480ca tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:51.162206 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-541bc73e-37f5-4435-8e94-ddf5e3c480ca tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:51.162889 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-541bc73e-37f5-4435-8e94-ddf5e3c480ca tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:51.163365 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-541bc73e-37f5-4435-8e94-ddf5e3c480ca tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:51.163890 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-541bc73e-37f5-4435-8e94-ddf5e3c480ca tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:51.300587 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-541bc73e-37f5-4435-8e94-ddf5e3c480ca tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:51.308279 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-541bc73e-37f5-4435-8e94-ddf5e3c480ca tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45" status: 200 len: 1556 microversion: 2.1 time: 0.161393 Sep 06 01:15:51.308841 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 334/692] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:51 2022] GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 => generated 1556 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:51.329999 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-6acfa2b0-2dfb-442c-835d-629cd05bfa48 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:51.330512 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-6acfa2b0-2dfb-442c-835d-629cd05bfa48 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: a23ae8e0-f66b-46e1-a6fe-ac890b3efe45] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:51.337359 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6acfa2b0-2dfb-442c-835d-629cd05bfa48 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:51.337836 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6acfa2b0-2dfb-442c-835d-629cd05bfa48 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:51.338265 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6acfa2b0-2dfb-442c-835d-629cd05bfa48 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:51.338980 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6acfa2b0-2dfb-442c-835d-629cd05bfa48 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:51.339424 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6acfa2b0-2dfb-442c-835d-629cd05bfa48 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:51.339877 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6acfa2b0-2dfb-442c-835d-629cd05bfa48 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:51.420279 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-6acfa2b0-2dfb-442c-835d-629cd05bfa48 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093916 Sep 06 01:15:51.420863 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 359/693] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Sep 6 01:15:51 2022] GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:15:52.619543 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-9ead6b0b-b7c5-470c-a5e2-37c0bbb4cee9 req-6425d38c-b6d5-4a54-b868-355d972aeb57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a23ae8e0-f66b-46e1-a6fe-ac890b3efe45", "tag": "90ca3270-3768-4e11-aa21-10a962ec5f79"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:15:52.631095 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9ead6b0b-b7c5-470c-a5e2-37c0bbb4cee9 req-6425d38c-b6d5-4a54-b868-355d972aeb57 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:52.631682 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9ead6b0b-b7c5-470c-a5e2-37c0bbb4cee9 req-6425d38c-b6d5-4a54-b868-355d972aeb57 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:52.632205 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9ead6b0b-b7c5-470c-a5e2-37c0bbb4cee9 req-6425d38c-b6d5-4a54-b868-355d972aeb57 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:52.643166 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-9ead6b0b-b7c5-470c-a5e2-37c0bbb4cee9 req-6425d38c-b6d5-4a54-b868-355d972aeb57 service nova] Creating event network-changed:90ca3270-3768-4e11-aa21-10a962ec5f79 for instance a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 on hv-cinder-84773 Sep 06 01:15:52.649728 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-9ead6b0b-b7c5-470c-a5e2-37c0bbb4cee9 req-6425d38c-b6d5-4a54-b868-355d972aeb57 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033867 Sep 06 01:15:52.650485 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 335/694] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:15:57.712269 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-764ccb00-a215-4a74-93e0-94f16b817faf tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:15:57.712269 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-764ccb00-a215-4a74-93e0-94f16b817faf tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:57.716783 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-764ccb00-a215-4a74-93e0-94f16b817faf tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:57.717245 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-764ccb00-a215-4a74-93e0-94f16b817faf tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:57.717679 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-764ccb00-a215-4a74-93e0-94f16b817faf tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:57.718378 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-764ccb00-a215-4a74-93e0-94f16b817faf tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:57.718828 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-764ccb00-a215-4a74-93e0-94f16b817faf tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:57.719248 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-764ccb00-a215-4a74-93e0-94f16b817faf tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:57.750405 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.objects.instance [None req-764ccb00-a215-4a74-93e0-94f16b817faf tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lazy-loading 'flavor' on Instance uuid ce3f054d-45b3-41c2-9f87-c32efa7bc088 {{(pid=120580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 01:15:57.894798 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:15:57.915503 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-764ccb00-a215-4a74-93e0-94f16b817faf tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "POST /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088/action" status: 200 len: 32 microversion: 2.1 time: 0.212591 Sep 06 01:15:57.916144 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 360/695] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Sep 6 01:15:57 2022] POST /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088/action => generated 32 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 01:15:57.927108 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-db16f26d-a32e-4b50-917c-758622a89f6a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:57.927833 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-db16f26d-a32e-4b50-917c-758622a89f6a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:57.934525 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db16f26d-a32e-4b50-917c-758622a89f6a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:57.935023 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db16f26d-a32e-4b50-917c-758622a89f6a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:57.935605 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db16f26d-a32e-4b50-917c-758622a89f6a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:57.936400 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db16f26d-a32e-4b50-917c-758622a89f6a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:57.936907 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db16f26d-a32e-4b50-917c-758622a89f6a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:57.937375 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db16f26d-a32e-4b50-917c-758622a89f6a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:57.942078 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:15:58.075044 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-db16f26d-a32e-4b50-917c-758622a89f6a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:58.083403 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-db16f26d-a32e-4b50-917c-758622a89f6a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1736 microversion: 2.1 time: 0.161084 Sep 06 01:15:58.084011 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 336/696] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:57 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:15:59.108693 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-28591c97-c8d3-411e-9459-a076f1bbdaf5 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:15:59.109319 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-28591c97-c8d3-411e-9459-a076f1bbdaf5 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:15:59.115356 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-28591c97-c8d3-411e-9459-a076f1bbdaf5 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:59.115894 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-28591c97-c8d3-411e-9459-a076f1bbdaf5 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:59.116330 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-28591c97-c8d3-411e-9459-a076f1bbdaf5 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:59.117031 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-28591c97-c8d3-411e-9459-a076f1bbdaf5 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:15:59.117480 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-28591c97-c8d3-411e-9459-a076f1bbdaf5 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:15:59.117906 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-28591c97-c8d3-411e-9459-a076f1bbdaf5 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:15:59.247232 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-28591c97-c8d3-411e-9459-a076f1bbdaf5 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:15:59.256756 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-28591c97-c8d3-411e-9459-a076f1bbdaf5 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1736 microversion: 2.1 time: 0.153164 Sep 06 01:15:59.257322 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 361/697] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:15:59 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:00.280939 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6d2bc2c7-1a9d-4e59-b450-df0e84849994 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:00.281481 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6d2bc2c7-1a9d-4e59-b450-df0e84849994 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:00.289046 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d2bc2c7-1a9d-4e59-b450-df0e84849994 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:00.289703 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d2bc2c7-1a9d-4e59-b450-df0e84849994 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:00.290248 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d2bc2c7-1a9d-4e59-b450-df0e84849994 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:00.290987 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d2bc2c7-1a9d-4e59-b450-df0e84849994 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:00.291519 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d2bc2c7-1a9d-4e59-b450-df0e84849994 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:00.292004 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d2bc2c7-1a9d-4e59-b450-df0e84849994 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:00.425926 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-6d2bc2c7-1a9d-4e59-b450-df0e84849994 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:00.434021 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6d2bc2c7-1a9d-4e59-b450-df0e84849994 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1736 microversion: 2.1 time: 0.157092 Sep 06 01:16:00.434582 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 337/698] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:00 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:16:01.457499 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-2f633f7b-386f-44ac-a0db-90cb8e39ef70 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:01.458116 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-2f633f7b-386f-44ac-a0db-90cb8e39ef70 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:01.464959 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2f633f7b-386f-44ac-a0db-90cb8e39ef70 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:01.465591 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2f633f7b-386f-44ac-a0db-90cb8e39ef70 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:01.466076 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2f633f7b-386f-44ac-a0db-90cb8e39ef70 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:01.466840 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2f633f7b-386f-44ac-a0db-90cb8e39ef70 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:01.467346 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2f633f7b-386f-44ac-a0db-90cb8e39ef70 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:01.467900 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2f633f7b-386f-44ac-a0db-90cb8e39ef70 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:01.597991 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-2f633f7b-386f-44ac-a0db-90cb8e39ef70 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:01.606352 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-2f633f7b-386f-44ac-a0db-90cb8e39ef70 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1736 microversion: 2.1 time: 0.152875 Sep 06 01:16:01.606916 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 362/699] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:01 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:02.629647 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-92979196-06d0-40c7-8ba3-e1cb9ef8c6f4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:02.630258 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-92979196-06d0-40c7-8ba3-e1cb9ef8c6f4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:02.636645 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92979196-06d0-40c7-8ba3-e1cb9ef8c6f4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:02.637119 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92979196-06d0-40c7-8ba3-e1cb9ef8c6f4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:02.637552 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92979196-06d0-40c7-8ba3-e1cb9ef8c6f4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:02.638226 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92979196-06d0-40c7-8ba3-e1cb9ef8c6f4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:02.638672 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92979196-06d0-40c7-8ba3-e1cb9ef8c6f4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:02.639089 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92979196-06d0-40c7-8ba3-e1cb9ef8c6f4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:02.766229 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-92979196-06d0-40c7-8ba3-e1cb9ef8c6f4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:02.775025 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-92979196-06d0-40c7-8ba3-e1cb9ef8c6f4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1736 microversion: 2.1 time: 0.149282 Sep 06 01:16:02.775602 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 338/700] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:02 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:03.798672 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-10ebe8b4-1f9e-49df-9659-f5fc475d785b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:03.799291 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-10ebe8b4-1f9e-49df-9659-f5fc475d785b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:03.806254 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-10ebe8b4-1f9e-49df-9659-f5fc475d785b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:03.806731 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-10ebe8b4-1f9e-49df-9659-f5fc475d785b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:03.807164 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-10ebe8b4-1f9e-49df-9659-f5fc475d785b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:03.807878 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-10ebe8b4-1f9e-49df-9659-f5fc475d785b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:03.808333 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-10ebe8b4-1f9e-49df-9659-f5fc475d785b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:03.808757 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-10ebe8b4-1f9e-49df-9659-f5fc475d785b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:03.887547 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cc171783-60e3-4c9e-bc1d-e6c6cd502b0e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:03.888113 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cc171783-60e3-4c9e-bc1d-e6c6cd502b0e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:03.894287 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc171783-60e3-4c9e-bc1d-e6c6cd502b0e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:03.895058 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc171783-60e3-4c9e-bc1d-e6c6cd502b0e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:03.895485 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc171783-60e3-4c9e-bc1d-e6c6cd502b0e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:03.896194 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc171783-60e3-4c9e-bc1d-e6c6cd502b0e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:03.896640 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc171783-60e3-4c9e-bc1d-e6c6cd502b0e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:03.897057 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc171783-60e3-4c9e-bc1d-e6c6cd502b0e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:03.926756 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cc171783-60e3-4c9e-bc1d-e6c6cd502b0e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125/os-volume_attachments/195e466f-2a60-465a-8e2c-838dfdb5c139" status: 200 len: 194 microversion: 2.20 time: 0.043283 Sep 06 01:16:03.927358 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 339/701] 10.222.0.23 () {60 vars in 1454 bytes} [Tue Sep 6 01:16:03 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125/os-volume_attachments/195e466f-2a60-465a-8e2c-838dfdb5c139 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 01:16:03.947136 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-10ebe8b4-1f9e-49df-9659-f5fc475d785b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:03.955385 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-10ebe8b4-1f9e-49df-9659-f5fc475d785b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1736 microversion: 2.1 time: 0.160607 Sep 06 01:16:03.956566 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 363/702] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:03 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:03.995537 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-92c8cf21-dc9a-47a3-8106-1b4723b8bd12 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:03.996050 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-92c8cf21-dc9a-47a3-8106-1b4723b8bd12 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:04.001927 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92c8cf21-dc9a-47a3-8106-1b4723b8bd12 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:04.002398 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92c8cf21-dc9a-47a3-8106-1b4723b8bd12 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:04.002829 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92c8cf21-dc9a-47a3-8106-1b4723b8bd12 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:04.003512 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92c8cf21-dc9a-47a3-8106-1b4723b8bd12 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:04.003993 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92c8cf21-dc9a-47a3-8106-1b4723b8bd12 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:04.004506 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92c8cf21-dc9a-47a3-8106-1b4723b8bd12 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:04.086260 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-92c8cf21-dc9a-47a3-8106-1b4723b8bd12 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lazy-loading 'services' on Instance uuid c42df4ca-a678-4b12-b5dc-3f3c0af93125 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 01:16:04.156875 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-92c8cf21-dc9a-47a3-8106-1b4723b8bd12 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125/os-volume_attachments/195e466f-2a60-465a-8e2c-838dfdb5c139" status: 202 len: 0 microversion: 2.20 time: 0.165124 Sep 06 01:16:04.157619 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 340/703] 10.222.0.23 () {60 vars in 1457 bytes} [Tue Sep 6 01:16:03 2022] DELETE /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125/os-volume_attachments/195e466f-2a60-465a-8e2c-838dfdb5c139 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 01:16:04.166406 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-b7406333-9779-4ce6-a3d4-13d93d59a224 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:04.169451 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-b7406333-9779-4ce6-a3d4-13d93d59a224 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:04.176121 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b7406333-9779-4ce6-a3d4-13d93d59a224 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:04.176616 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b7406333-9779-4ce6-a3d4-13d93d59a224 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:04.177227 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b7406333-9779-4ce6-a3d4-13d93d59a224 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:04.178125 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b7406333-9779-4ce6-a3d4-13d93d59a224 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:04.178725 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b7406333-9779-4ce6-a3d4-13d93d59a224 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:04.179293 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b7406333-9779-4ce6-a3d4-13d93d59a224 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:04.213116 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-b7406333-9779-4ce6-a3d4-13d93d59a224 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050497 Sep 06 01:16:04.213644 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 364/704] 10.222.0.23 () {60 vars in 1343 bytes} [Tue Sep 6 01:16:04 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 01:16:04.979262 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-463a8782-833b-4f89-92f3-ba6b812c7762 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:04.980022 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-463a8782-833b-4f89-92f3-ba6b812c7762 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:04.986547 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-463a8782-833b-4f89-92f3-ba6b812c7762 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:04.987513 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-463a8782-833b-4f89-92f3-ba6b812c7762 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:04.988184 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-463a8782-833b-4f89-92f3-ba6b812c7762 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:04.988867 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-463a8782-833b-4f89-92f3-ba6b812c7762 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:04.989314 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-463a8782-833b-4f89-92f3-ba6b812c7762 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:04.989734 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-463a8782-833b-4f89-92f3-ba6b812c7762 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:05.133260 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-463a8782-833b-4f89-92f3-ba6b812c7762 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:05.141690 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-463a8782-833b-4f89-92f3-ba6b812c7762 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1736 microversion: 2.1 time: 0.166609 Sep 06 01:16:05.142566 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 341/705] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:04 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:05.225561 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-ca37142f-4532-4134-a2dd-cdd21eafc4c8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:05.227736 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-ca37142f-4532-4134-a2dd-cdd21eafc4c8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:05.234080 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ca37142f-4532-4134-a2dd-cdd21eafc4c8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:05.234568 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ca37142f-4532-4134-a2dd-cdd21eafc4c8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:05.235008 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ca37142f-4532-4134-a2dd-cdd21eafc4c8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:05.235692 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ca37142f-4532-4134-a2dd-cdd21eafc4c8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:05.236169 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ca37142f-4532-4134-a2dd-cdd21eafc4c8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:05.236594 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ca37142f-4532-4134-a2dd-cdd21eafc4c8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:05.265319 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-ca37142f-4532-4134-a2dd-cdd21eafc4c8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044262 Sep 06 01:16:05.265870 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 365/706] 10.222.0.23 () {60 vars in 1343 bytes} [Tue Sep 6 01:16:05 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:05.330619 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-94723f8b-b38f-4b72-abe1-213169849d21 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:05.331118 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-94723f8b-b38f-4b72-abe1-213169849d21 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:05.337025 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-94723f8b-b38f-4b72-abe1-213169849d21 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:05.337502 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-94723f8b-b38f-4b72-abe1-213169849d21 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:05.337936 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-94723f8b-b38f-4b72-abe1-213169849d21 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:05.338619 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-94723f8b-b38f-4b72-abe1-213169849d21 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:05.339070 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-94723f8b-b38f-4b72-abe1-213169849d21 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:05.339492 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-94723f8b-b38f-4b72-abe1-213169849d21 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:05.364861 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-94723f8b-b38f-4b72-abe1-213169849d21 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 01:16:05.437074 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-94723f8b-b38f-4b72-abe1-213169849d21 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 204 len: 0 microversion: 2.20 time: 0.109891 Sep 06 01:16:05.437646 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 342/707] 10.222.0.23 () {60 vars in 1280 bytes} [Tue Sep 6 01:16:05 2022] DELETE /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 01:16:05.445905 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-dc64ffdd-a0d7-4965-b313-7bfffc72a29d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:05.446686 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-dc64ffdd-a0d7-4965-b313-7bfffc72a29d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:05.452659 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dc64ffdd-a0d7-4965-b313-7bfffc72a29d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:05.453142 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dc64ffdd-a0d7-4965-b313-7bfffc72a29d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:05.453579 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dc64ffdd-a0d7-4965-b313-7bfffc72a29d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:05.454263 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dc64ffdd-a0d7-4965-b313-7bfffc72a29d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:05.454717 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dc64ffdd-a0d7-4965-b313-7bfffc72a29d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:05.455139 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dc64ffdd-a0d7-4965-b313-7bfffc72a29d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:05.588961 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-dc64ffdd-a0d7-4965-b313-7bfffc72a29d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:05.597798 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-dc64ffdd-a0d7-4965-b313-7bfffc72a29d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:05.599231 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-dc64ffdd-a0d7-4965-b313-7bfffc72a29d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:05.600437 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-dc64ffdd-a0d7-4965-b313-7bfffc72a29d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1724 microversion: 2.20 time: 0.158554 Sep 06 01:16:05.600986 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 366/708] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:16:05 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:16:06.165272 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a5fc132a-a764-4eb8-9c45-ebc1a8fbbbd3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:06.165997 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a5fc132a-a764-4eb8-9c45-ebc1a8fbbbd3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:06.172730 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a5fc132a-a764-4eb8-9c45-ebc1a8fbbbd3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:06.173208 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a5fc132a-a764-4eb8-9c45-ebc1a8fbbbd3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:06.173636 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a5fc132a-a764-4eb8-9c45-ebc1a8fbbbd3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:06.174318 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a5fc132a-a764-4eb8-9c45-ebc1a8fbbbd3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:06.174765 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a5fc132a-a764-4eb8-9c45-ebc1a8fbbbd3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:06.175184 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a5fc132a-a764-4eb8-9c45-ebc1a8fbbbd3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:06.306646 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-a5fc132a-a764-4eb8-9c45-ebc1a8fbbbd3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:06.314989 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a5fc132a-a764-4eb8-9c45-ebc1a8fbbbd3 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1736 microversion: 2.1 time: 0.153933 Sep 06 01:16:06.315553 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 343/709] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:06 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:06.624867 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-a8f500e5-34a0-46d0-a527-a0d60516f1e9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:06.625473 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-a8f500e5-34a0-46d0-a527-a0d60516f1e9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:06.631884 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a8f500e5-34a0-46d0-a527-a0d60516f1e9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:06.632361 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a8f500e5-34a0-46d0-a527-a0d60516f1e9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:06.632790 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a8f500e5-34a0-46d0-a527-a0d60516f1e9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:06.633465 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a8f500e5-34a0-46d0-a527-a0d60516f1e9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:06.633909 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a8f500e5-34a0-46d0-a527-a0d60516f1e9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:06.634323 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a8f500e5-34a0-46d0-a527-a0d60516f1e9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:06.763218 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-a8f500e5-34a0-46d0-a527-a0d60516f1e9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:06.771740 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-a8f500e5-34a0-46d0-a527-a0d60516f1e9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:06.773190 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-a8f500e5-34a0-46d0-a527-a0d60516f1e9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:06.774326 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-a8f500e5-34a0-46d0-a527-a0d60516f1e9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1724 microversion: 2.20 time: 0.153460 Sep 06 01:16:06.774868 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 367/710] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:16:06 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:16:07.339067 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8ec41c78-07e2-4481-88c5-8adc467271dd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:07.339662 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8ec41c78-07e2-4481-88c5-8adc467271dd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:07.346106 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8ec41c78-07e2-4481-88c5-8adc467271dd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:07.346586 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8ec41c78-07e2-4481-88c5-8adc467271dd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:07.347020 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8ec41c78-07e2-4481-88c5-8adc467271dd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:07.347745 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8ec41c78-07e2-4481-88c5-8adc467271dd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:07.348226 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8ec41c78-07e2-4481-88c5-8adc467271dd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:07.348644 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8ec41c78-07e2-4481-88c5-8adc467271dd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:07.660244 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-8ec41c78-07e2-4481-88c5-8adc467271dd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:07.668723 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8ec41c78-07e2-4481-88c5-8adc467271dd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1736 microversion: 2.1 time: 0.333861 Sep 06 01:16:07.669279 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 344/711] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:07 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1736 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:07.803177 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-253ccbf3-1472-41c7-8667-6667a7139d3b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:07.804588 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-253ccbf3-1472-41c7-8667-6667a7139d3b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:07.812002 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-253ccbf3-1472-41c7-8667-6667a7139d3b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:07.812489 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-253ccbf3-1472-41c7-8667-6667a7139d3b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:07.812978 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-253ccbf3-1472-41c7-8667-6667a7139d3b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:07.813720 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-253ccbf3-1472-41c7-8667-6667a7139d3b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:07.814174 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-253ccbf3-1472-41c7-8667-6667a7139d3b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:07.814602 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-253ccbf3-1472-41c7-8667-6667a7139d3b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:07.951153 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-253ccbf3-1472-41c7-8667-6667a7139d3b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:07.959418 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-253ccbf3-1472-41c7-8667-6667a7139d3b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:07.960925 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-253ccbf3-1472-41c7-8667-6667a7139d3b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:07.962090 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-253ccbf3-1472-41c7-8667-6667a7139d3b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1724 microversion: 2.20 time: 0.165346 Sep 06 01:16:07.962646 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 368/712] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:16:07 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:16:08.397030 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-4725f8ec-801d-423f-829a-96c1e79ff870 req-7b00832d-c86a-4a71-9c60-2938b2f52a0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c42df4ca-a678-4b12-b5dc-3f3c0af93125", "name": "network-vif-deleted", "tag": "9f5084ac-bd14-44b7-bba5-06b59fd5291e"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:16:08.413063 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-4725f8ec-801d-423f-829a-96c1e79ff870 req-7b00832d-c86a-4a71-9c60-2938b2f52a0a service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:08.413858 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-4725f8ec-801d-423f-829a-96c1e79ff870 req-7b00832d-c86a-4a71-9c60-2938b2f52a0a service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:08.414497 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-4725f8ec-801d-423f-829a-96c1e79ff870 req-7b00832d-c86a-4a71-9c60-2938b2f52a0a service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:08.434783 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-4725f8ec-801d-423f-829a-96c1e79ff870 req-7b00832d-c86a-4a71-9c60-2938b2f52a0a service nova] Creating event network-vif-deleted:9f5084ac-bd14-44b7-bba5-06b59fd5291e for instance c42df4ca-a678-4b12-b5dc-3f3c0af93125 on hv-cinder-84773 Sep 06 01:16:08.439850 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-4725f8ec-801d-423f-829a-96c1e79ff870 req-7b00832d-c86a-4a71-9c60-2938b2f52a0a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047050 Sep 06 01:16:08.440440 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 345/713] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:16:08.694379 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-eedfbfc7-3ddd-4d4e-a738-e78866501403 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:08.695983 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-eedfbfc7-3ddd-4d4e-a738-e78866501403 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:08.701680 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-eedfbfc7-3ddd-4d4e-a738-e78866501403 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:08.702467 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-eedfbfc7-3ddd-4d4e-a738-e78866501403 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:08.703156 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-eedfbfc7-3ddd-4d4e-a738-e78866501403 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:08.704135 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-eedfbfc7-3ddd-4d4e-a738-e78866501403 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:08.704786 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-eedfbfc7-3ddd-4d4e-a738-e78866501403 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:08.705408 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-eedfbfc7-3ddd-4d4e-a738-e78866501403 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:08.867587 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-eedfbfc7-3ddd-4d4e-a738-e78866501403 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:08.876857 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-eedfbfc7-3ddd-4d4e-a738-e78866501403 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1736 microversion: 2.1 time: 0.188150 Sep 06 01:16:08.884066 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 369/714] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:08 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1736 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:08.989056 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e07a35e0-c009-4cf2-9cff-a17423cd8a9c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:08.989745 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e07a35e0-c009-4cf2-9cff-a17423cd8a9c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:08.995985 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e07a35e0-c009-4cf2-9cff-a17423cd8a9c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:08.996463 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e07a35e0-c009-4cf2-9cff-a17423cd8a9c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:08.996888 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e07a35e0-c009-4cf2-9cff-a17423cd8a9c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:08.997577 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e07a35e0-c009-4cf2-9cff-a17423cd8a9c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:08.998025 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e07a35e0-c009-4cf2-9cff-a17423cd8a9c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:08.998466 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e07a35e0-c009-4cf2-9cff-a17423cd8a9c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:09.035068 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e07a35e0-c009-4cf2-9cff-a17423cd8a9c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:09.039639 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e07a35e0-c009-4cf2-9cff-a17423cd8a9c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:09.039639 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e07a35e0-c009-4cf2-9cff-a17423cd8a9c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:09.039639 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-e07a35e0-c009-4cf2-9cff-a17423cd8a9c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lazy-loading 'fault' on Instance uuid c42df4ca-a678-4b12-b5dc-3f3c0af93125 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 01:16:09.079558 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-e07a35e0-c009-4cf2-9cff-a17423cd8a9c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:09.088734 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-e07a35e0-c009-4cf2-9cff-a17423cd8a9c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:09.090246 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-e07a35e0-c009-4cf2-9cff-a17423cd8a9c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:09.091473 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e07a35e0-c009-4cf2-9cff-a17423cd8a9c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 200 len: 1372 microversion: 2.20 time: 0.107430 Sep 06 01:16:09.092304 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 346/715] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:16:08 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 1372 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:16:09.901168 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-de333599-ee50-460f-815c-3a2604feba56 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:09.901757 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-de333599-ee50-460f-815c-3a2604feba56 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:09.908164 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-de333599-ee50-460f-815c-3a2604feba56 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:09.908641 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-de333599-ee50-460f-815c-3a2604feba56 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:09.909072 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-de333599-ee50-460f-815c-3a2604feba56 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:09.909822 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-de333599-ee50-460f-815c-3a2604feba56 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:09.910272 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-de333599-ee50-460f-815c-3a2604feba56 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:09.910691 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-de333599-ee50-460f-815c-3a2604feba56 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:10.037773 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-de333599-ee50-460f-815c-3a2604feba56 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:10.046692 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-de333599-ee50-460f-815c-3a2604feba56 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1736 microversion: 2.1 time: 0.149382 Sep 06 01:16:10.047254 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 370/716] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:09 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:10.118957 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2fe6ce24-2a42-438f-8094-74f2f17ecf1e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:10.119556 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2fe6ce24-2a42-438f-8094-74f2f17ecf1e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:10.125952 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2fe6ce24-2a42-438f-8094-74f2f17ecf1e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:10.126423 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2fe6ce24-2a42-438f-8094-74f2f17ecf1e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:10.126851 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2fe6ce24-2a42-438f-8094-74f2f17ecf1e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:10.127583 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2fe6ce24-2a42-438f-8094-74f2f17ecf1e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:10.128050 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2fe6ce24-2a42-438f-8094-74f2f17ecf1e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:10.129106 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2fe6ce24-2a42-438f-8094-74f2f17ecf1e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:10.142301 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-2fe6ce24-2a42-438f-8094-74f2f17ecf1e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] HTTP exception thrown: Instance c42df4ca-a678-4b12-b5dc-3f3c0af93125 could not be found. Sep 06 01:16:10.143961 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2fe6ce24-2a42-438f-8094-74f2f17ecf1e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Request method failure captured: Sep 06 01:16:10.143961 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 HTTP/1.1 Sep 06 01:16:10.143961 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept: application/json Sep 06 01:16:10.143961 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept-Encoding: identity Sep 06 01:16:10.143961 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Connection: close Sep 06 01:16:10.143961 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Length: 0 Sep 06 01:16:10.143961 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Type: application/json Sep 06 01:16:10.143961 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Host: 10.222.0.23 Sep 06 01:16:10.143961 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Openstack-System-Scope: None Sep 06 01:16:10.143961 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Sep 06 01:16:10.143961 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjFp5Jd8tx02fVidBaBnu-tf9SqWjO3jnfzKjDhWmOsqgzVcujsHvhG9DLM-9PrGpJG5qdT7IdxHca8UUwPoYffUs9KdEuslWnHY3r_drNtbTZucfHaK6FuPy4dVD0Cvi2Id4jiWbo0XFkjIVQdjNM3FOOqntUj2-Cl0QwEXuE8Co1F1o Sep 06 01:16:10.143961 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Id: None Sep 06 01:16:10.143961 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Name: None Sep 06 01:16:10.143961 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Identity-Status: Confirmed Sep 06 01:16:10.143961 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Is-Admin-Project: True Sep 06 01:16:10.143961 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 01:16:10.143961 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Id: default Sep 06 01:16:10.143961 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Name: Default Sep 06 01:16:10.143961 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Id: 1c096a50088a4b8dbd00458b324f301e Sep 06 01:16:10.143961 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2103393715 Sep 06 01:16:10.143961 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Role: reader,member Sep 06 01:16:10.143961 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Roles: reader,member Sep 06 01:16:10.145645 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c096a50088a4b8dbd00458b324f301e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1c096a50088a4b8dbd00458b324f301e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1c096a50088a4b8dbd00458b324f301e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c096a50088a4b8dbd00458b324f301e"}]}] Sep 06 01:16:10.145645 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2103393715 Sep 06 01:16:10.145645 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Id: 1c096a50088a4b8dbd00458b324f301e Sep 06 01:16:10.145645 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2103393715 Sep 06 01:16:10.145645 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User: tempest-AttachVolumeShelveTestJSON-2103393715-project Sep 06 01:16:10.145645 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Id: default Sep 06 01:16:10.145645 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Name: Default Sep 06 01:16:10.145645 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Id: 2dc5c46544a447159b7fd3d225cd9697 Sep 06 01:16:10.145645 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2103393715-project Sep 06 01:16:10.145645 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: method: > Sep 06 01:16:10.145645 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: exception: Instance c42df4ca-a678-4b12-b5dc-3f3c0af93125 could not be found. Sep 06 01:16:10.145645 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: action_args: {'id': 'c42df4ca-a678-4b12-b5dc-3f3c0af93125'} Sep 06 01:16:10.146771 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:16:10.146771 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:16:10.146771 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 01:16:10.146771 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 01:16:10.146771 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 01:16:10.146771 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 01:16:10.146771 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 01:16:10.146771 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 01:16:10.146771 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 01:16:10.146771 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 01:16:10.146771 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c42df4ca-a678-4b12-b5dc-3f3c0af93125 could not be found. Sep 06 01:16:10.146771 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:16:10.146771 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:16:10.146771 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:16:10.146771 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:16:10.146771 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:16:10.146771 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:16:10.146771 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:16:10.146771 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:16:10.146771 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:16:10.148335 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:16:10.148335 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 01:16:10.148335 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 01:16:10.148335 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 01:16:10.148335 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 01:16:10.148335 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 01:16:10.148335 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:16:10.148335 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c42df4ca-a678-4b12-b5dc-3f3c0af93125 could not be found. Sep 06 01:16:10.148335 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:16:10.148335 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:16:10.148335 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:16:10.148335 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:16:10.148335 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:16:10.148335 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:16:10.148335 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:16:10.148335 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:16:10.148335 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c42df4ca-a678-4b12-b5dc-3f3c0af93125 could not be found. Sep 06 01:16:10.148335 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:16:10.149806 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2fe6ce24-2a42-438f-8094-74f2f17ecf1e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Returning 404 to user: Instance c42df4ca-a678-4b12-b5dc-3f3c0af93125 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:16:10.149806 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2fe6ce24-2a42-438f-8094-74f2f17ecf1e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 404 len: 111 microversion: 2.20 time: 0.030342 Sep 06 01:16:10.149806 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 347/717] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:16:10 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 01:16:10.154248 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-7b225935-869c-4682-ae8b-68770f1ae257 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '.version_select at 0x7fb06e02edc0>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:10.175942 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-7b225935-869c-4682-ae8b-68770f1ae257 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1466073252" status: 204 len: 0 microversion: 2.20 time: 0.025008 Sep 06 01:16:10.176518 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 371/718] 10.222.0.23 () {60 vars in 1262 bytes} [Tue Sep 6 01:16:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1466073252 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 06 01:16:10.836926 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e70e167b-17bf-4ec4-8711-081d1125d67e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Action: 'create', calling method: .version_select at 0x7fb06e05ed30>, body: {"keypair": {"name": "tempest-keypair-457567430", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM6DZwizper3AFOxFBwybHqwjfWwJML9oCo5GOJsjQ4b6EEmB3B9CrRyZk5rg2osEnKEpk21809fxiu3wAzYWiNDaM/qEMlzxpLxWjgOUmjg82EY1A+tk58LqKbs7SDReg=="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:16:10.852771 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.quota [None req-e70e167b-17bf-4ec4-8711-081d1125d67e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Getting quotas for project 1c096a50088a4b8dbd00458b324f301e. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 01:16:10.856720 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.quota [None req-e70e167b-17bf-4ec4-8711-081d1125d67e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Getting quotas for user 2dc5c46544a447159b7fd3d225cd9697 and project 1c096a50088a4b8dbd00458b324f301e. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 01:16:10.877621 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e70e167b-17bf-4ec4-8711-081d1125d67e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.045894 Sep 06 01:16:10.878207 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 348/719] 10.222.0.23 () {62 vars in 1200 bytes} [Tue Sep 6 01:16:10 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 06 01:16:11.071388 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-07f3275c-c7b3-4477-a298-b619e7439284 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:11.072079 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-07f3275c-c7b3-4477-a298-b619e7439284 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:11.074447 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:16:11.080110 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-07f3275c-c7b3-4477-a298-b619e7439284 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:11.080818 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-07f3275c-c7b3-4477-a298-b619e7439284 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:11.081257 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-07f3275c-c7b3-4477-a298-b619e7439284 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:11.082584 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-07f3275c-c7b3-4477-a298-b619e7439284 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:11.083048 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-07f3275c-c7b3-4477-a298-b619e7439284 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:11.083474 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-07f3275c-c7b3-4477-a298-b619e7439284 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:11.218041 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-07f3275c-c7b3-4477-a298-b619e7439284 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:11.226676 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-07f3275c-c7b3-4477-a298-b619e7439284 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1736 microversion: 2.1 time: 0.159698 Sep 06 01:16:11.227402 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 372/720] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:11 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:11.969218 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-28b1004e-c8f0-47bd-8a84-66cdaefc9791 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:16:11.971437 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-28b1004e-c8f0-47bd-8a84-66cdaefc9791 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:11.978594 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28b1004e-c8f0-47bd-8a84-66cdaefc9791 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:11.979082 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28b1004e-c8f0-47bd-8a84-66cdaefc9791 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:11.979586 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28b1004e-c8f0-47bd-8a84-66cdaefc9791 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:11.980397 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28b1004e-c8f0-47bd-8a84-66cdaefc9791 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:11.980850 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28b1004e-c8f0-47bd-8a84-66cdaefc9791 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:11.981281 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28b1004e-c8f0-47bd-8a84-66cdaefc9791 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:12.065064 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-28b1004e-c8f0-47bd-8a84-66cdaefc9791 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "POST /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d/action" status: 202 len: 0 microversion: 2.1 time: 0.099649 Sep 06 01:16:12.065544 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 349/721] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Sep 6 01:16:11 2022] POST /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 01:16:12.074072 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-e593fec1-cd47-42f0-b4ed-2724ef1cea16 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:12.074685 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-e593fec1-cd47-42f0-b4ed-2724ef1cea16 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:12.082094 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e593fec1-cd47-42f0-b4ed-2724ef1cea16 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:12.082549 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e593fec1-cd47-42f0-b4ed-2724ef1cea16 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:12.082988 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e593fec1-cd47-42f0-b4ed-2724ef1cea16 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:12.083683 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e593fec1-cd47-42f0-b4ed-2724ef1cea16 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:12.084350 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e593fec1-cd47-42f0-b4ed-2724ef1cea16 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:12.084774 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e593fec1-cd47-42f0-b4ed-2724ef1cea16 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:12.141154 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6e3ade71-0348-4218-a1e7-b2d23a54410f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2117017689", "imageRef": "768973cc-7b5f-4eed-b493-e40eb0de9f88", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f028d99a-9873-49ec-abeb-029461c8fb87"}], "security_groups": [{"name": "tempest-securitygroup--1964599165"}], "key_name": "tempest-keypair-457567430", "user_data": "}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:16:12.251156 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-e593fec1-cd47-42f0-b4ed-2724ef1cea16 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:12.260118 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-e593fec1-cd47-42f0-b4ed-2724ef1cea16 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1751 microversion: 2.1 time: 0.189733 Sep 06 01:16:12.260676 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 373/722] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:12 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1751 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:12.265897 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-6a74bb5d-d303-44d4-bbc5-be2d20f51bfc tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:12.266508 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-6a74bb5d-d303-44d4-bbc5-be2d20f51bfc tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:12.266746 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-6e3ade71-0348-4218-a1e7-b2d23a54410f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] validate_networks() for [('f028d99a-9873-49ec-abeb-029461c8fb87', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 01:16:12.272405 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6a74bb5d-d303-44d4-bbc5-be2d20f51bfc tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:12.272886 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6a74bb5d-d303-44d4-bbc5-be2d20f51bfc tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:12.273545 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6a74bb5d-d303-44d4-bbc5-be2d20f51bfc tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:12.274244 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6a74bb5d-d303-44d4-bbc5-be2d20f51bfc tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:12.274819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6a74bb5d-d303-44d4-bbc5-be2d20f51bfc tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:12.275249 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6a74bb5d-d303-44d4-bbc5-be2d20f51bfc tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:12.461320 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-6a74bb5d-d303-44d4-bbc5-be2d20f51bfc tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:12.469646 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-6a74bb5d-d303-44d4-bbc5-be2d20f51bfc tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1736 microversion: 2.1 time: 0.207698 Sep 06 01:16:12.470326 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 374/723] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:12 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1736 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:12.696409 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-6e3ade71-0348-4218-a1e7-b2d23a54410f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 01:16:12.696958 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-6e3ade71-0348-4218-a1e7-b2d23a54410f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 01:16:12.697550 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-6e3ade71-0348-4218-a1e7-b2d23a54410f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 01:16:12.698072 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-6e3ade71-0348-4218-a1e7-b2d23a54410f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 01:16:12.698543 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-6e3ade71-0348-4218-a1e7-b2d23a54410f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 01:16:12.707270 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e3ade71-0348-4218-a1e7-b2d23a54410f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:12.707745 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e3ade71-0348-4218-a1e7-b2d23a54410f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:12.708207 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e3ade71-0348-4218-a1e7-b2d23a54410f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:12.708900 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e3ade71-0348-4218-a1e7-b2d23a54410f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:12.709348 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e3ade71-0348-4218-a1e7-b2d23a54410f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:12.709763 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e3ade71-0348-4218-a1e7-b2d23a54410f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:12.729855 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.quota [None req-6e3ade71-0348-4218-a1e7-b2d23a54410f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Getting quotas for project 1c096a50088a4b8dbd00458b324f301e. Resources: {'instances', 'ram', 'cores'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 01:16:12.733910 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.quota [None req-6e3ade71-0348-4218-a1e7-b2d23a54410f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Getting quotas for user 2dc5c46544a447159b7fd3d225cd9697 and project 1c096a50088a4b8dbd00458b324f301e. Resources: {'instances', 'ram', 'cores'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 01:16:12.745293 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6e3ade71-0348-4218-a1e7-b2d23a54410f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 01:16:12.747664 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6e3ade71-0348-4218-a1e7-b2d23a54410f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='768973cc-7b5f-4eed-b493-e40eb0de9f88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 01:16:12.794276 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6e3ade71-0348-4218-a1e7-b2d23a54410f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.657751 Sep 06 01:16:12.794913 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 350/724] 10.222.0.23 () {62 vars in 1188 bytes} [Tue Sep 6 01:16:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 06 01:16:12.806455 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-78b12adf-0c99-42a9-9fe0-7de76983e7c0 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:12.807091 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-78b12adf-0c99-42a9-9fe0-7de76983e7c0 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:12.858707 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-78b12adf-0c99-42a9-9fe0-7de76983e7c0 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:12.866978 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-78b12adf-0c99-42a9-9fe0-7de76983e7c0 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:12.868443 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-78b12adf-0c99-42a9-9fe0-7de76983e7c0 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:12.869527 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-78b12adf-0c99-42a9-9fe0-7de76983e7c0 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1281 microversion: 2.20 time: 0.066949 Sep 06 01:16:12.870079 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 375/725] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:16:12 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1281 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:16:13.283843 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-188e7a28-ceec-46d7-b3d4-11b575088127 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:13.284453 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-188e7a28-ceec-46d7-b3d4-11b575088127 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:13.291713 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-188e7a28-ceec-46d7-b3d4-11b575088127 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:13.292484 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-188e7a28-ceec-46d7-b3d4-11b575088127 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:13.292913 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-188e7a28-ceec-46d7-b3d4-11b575088127 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:13.293593 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-188e7a28-ceec-46d7-b3d4-11b575088127 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:13.294045 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-188e7a28-ceec-46d7-b3d4-11b575088127 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:13.294462 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-188e7a28-ceec-46d7-b3d4-11b575088127 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:13.435114 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-188e7a28-ceec-46d7-b3d4-11b575088127 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:13.444129 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-188e7a28-ceec-46d7-b3d4-11b575088127 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1751 microversion: 2.1 time: 0.164524 Sep 06 01:16:13.446811 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 351/726] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:13 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1751 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:13.493567 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-f6d50118-10f5-4213-b480-069260022ce6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:13.494183 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-f6d50118-10f5-4213-b480-069260022ce6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:13.502319 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f6d50118-10f5-4213-b480-069260022ce6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:13.502851 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f6d50118-10f5-4213-b480-069260022ce6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:13.503287 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f6d50118-10f5-4213-b480-069260022ce6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:13.504553 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f6d50118-10f5-4213-b480-069260022ce6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:13.505007 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f6d50118-10f5-4213-b480-069260022ce6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:13.505458 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f6d50118-10f5-4213-b480-069260022ce6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:13.614409 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-910aba21-13f6-4b17-9437-9c9c614e6a55 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:13.615473 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-910aba21-13f6-4b17-9437-9c9c614e6a55 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:13.623541 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-910aba21-13f6-4b17-9437-9c9c614e6a55 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:13.624013 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-910aba21-13f6-4b17-9437-9c9c614e6a55 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:13.624540 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-910aba21-13f6-4b17-9437-9c9c614e6a55 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:13.625231 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-910aba21-13f6-4b17-9437-9c9c614e6a55 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:13.626130 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-910aba21-13f6-4b17-9437-9c9c614e6a55 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:13.626755 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-910aba21-13f6-4b17-9437-9c9c614e6a55 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:13.633668 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:16:13.671804 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-f6d50118-10f5-4213-b480-069260022ce6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:13.701327 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-f6d50118-10f5-4213-b480-069260022ce6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1736 microversion: 2.1 time: 0.211619 Sep 06 01:16:13.716057 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 376/727] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:13 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1736 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:13.730058 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-910aba21-13f6-4b17-9437-9c9c614e6a55 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lazy-loading 'services' on Instance uuid c116182e-e47e-4655-a30d-5f8d52772fba {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 01:16:13.810590 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-910aba21-13f6-4b17-9437-9c9c614e6a55 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba/os-volume_attachments/61041f52-8036-427c-a097-54f76913424c" status: 202 len: 0 microversion: 2.1 time: 0.200328 Sep 06 01:16:13.811169 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 352/728] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Sep 6 01:16:13 2022] DELETE /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba/os-volume_attachments/61041f52-8036-427c-a097-54f76913424c => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 01:16:13.901243 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-5c81ac39-3233-43e9-9a2c-28a711e42ffa tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:13.901939 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-5c81ac39-3233-43e9-9a2c-28a711e42ffa tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:13.908628 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5c81ac39-3233-43e9-9a2c-28a711e42ffa tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:13.909115 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5c81ac39-3233-43e9-9a2c-28a711e42ffa tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:13.909550 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5c81ac39-3233-43e9-9a2c-28a711e42ffa tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:13.910282 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5c81ac39-3233-43e9-9a2c-28a711e42ffa tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:13.910733 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5c81ac39-3233-43e9-9a2c-28a711e42ffa tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:13.911158 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5c81ac39-3233-43e9-9a2c-28a711e42ffa tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:13.971442 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-5c81ac39-3233-43e9-9a2c-28a711e42ffa tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:13.979367 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-5c81ac39-3233-43e9-9a2c-28a711e42ffa tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:13.980845 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-5c81ac39-3233-43e9-9a2c-28a711e42ffa tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:13.982065 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-5c81ac39-3233-43e9-9a2c-28a711e42ffa tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1333 microversion: 2.20 time: 0.084722 Sep 06 01:16:13.982615 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 377/729] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:16:13 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1333 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:16:14.469794 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4a2151a9-6664-405c-a439-520b38ac7aa4 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:14.470489 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4a2151a9-6664-405c-a439-520b38ac7aa4 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:14.477132 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a2151a9-6664-405c-a439-520b38ac7aa4 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:14.477630 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a2151a9-6664-405c-a439-520b38ac7aa4 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:14.478059 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a2151a9-6664-405c-a439-520b38ac7aa4 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:14.478733 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a2151a9-6664-405c-a439-520b38ac7aa4 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:14.479180 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a2151a9-6664-405c-a439-520b38ac7aa4 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:14.479596 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a2151a9-6664-405c-a439-520b38ac7aa4 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:14.620993 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-4a2151a9-6664-405c-a439-520b38ac7aa4 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:14.629057 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4a2151a9-6664-405c-a439-520b38ac7aa4 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1751 microversion: 2.1 time: 0.164083 Sep 06 01:16:14.629607 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 353/730] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:14 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:14.725805 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-209b3bb0-5b72-4d28-bec1-167101045cc7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:14.726345 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-209b3bb0-5b72-4d28-bec1-167101045cc7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:14.732846 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-209b3bb0-5b72-4d28-bec1-167101045cc7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:14.733330 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-209b3bb0-5b72-4d28-bec1-167101045cc7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:14.733763 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-209b3bb0-5b72-4d28-bec1-167101045cc7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:14.734466 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-209b3bb0-5b72-4d28-bec1-167101045cc7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:14.734915 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-209b3bb0-5b72-4d28-bec1-167101045cc7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:14.735361 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-209b3bb0-5b72-4d28-bec1-167101045cc7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:14.864770 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-209b3bb0-5b72-4d28-bec1-167101045cc7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:14.873097 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-209b3bb0-5b72-4d28-bec1-167101045cc7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1736 microversion: 2.1 time: 0.151789 Sep 06 01:16:14.873742 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 378/731] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:14 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:15.006884 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-38d5f2ea-837f-46ba-98d3-e9d92ce3be6d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:15.008157 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-38d5f2ea-837f-46ba-98d3-e9d92ce3be6d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:15.013777 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38d5f2ea-837f-46ba-98d3-e9d92ce3be6d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:15.014267 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38d5f2ea-837f-46ba-98d3-e9d92ce3be6d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:15.014704 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38d5f2ea-837f-46ba-98d3-e9d92ce3be6d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:15.015392 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38d5f2ea-837f-46ba-98d3-e9d92ce3be6d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:15.015886 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38d5f2ea-837f-46ba-98d3-e9d92ce3be6d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:15.016311 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38d5f2ea-837f-46ba-98d3-e9d92ce3be6d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:15.084768 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-38d5f2ea-837f-46ba-98d3-e9d92ce3be6d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:15.093476 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-38d5f2ea-837f-46ba-98d3-e9d92ce3be6d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:15.094932 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-38d5f2ea-837f-46ba-98d3-e9d92ce3be6d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:15.096075 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-38d5f2ea-837f-46ba-98d3-e9d92ce3be6d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1333 microversion: 2.20 time: 0.093639 Sep 06 01:16:15.096618 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 354/732] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:16:15 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1333 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:16:15.653352 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-53d833f2-54bc-4888-bbe6-194b3d9f2ccd tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:15.654211 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-53d833f2-54bc-4888-bbe6-194b3d9f2ccd tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:15.663438 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-53d833f2-54bc-4888-bbe6-194b3d9f2ccd tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:15.663970 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-53d833f2-54bc-4888-bbe6-194b3d9f2ccd tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:15.664412 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-53d833f2-54bc-4888-bbe6-194b3d9f2ccd tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:15.665186 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-53d833f2-54bc-4888-bbe6-194b3d9f2ccd tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:15.665658 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-53d833f2-54bc-4888-bbe6-194b3d9f2ccd tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:15.666136 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-53d833f2-54bc-4888-bbe6-194b3d9f2ccd tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:15.671077 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:16:15.818827 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-53d833f2-54bc-4888-bbe6-194b3d9f2ccd tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:15.826944 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-53d833f2-54bc-4888-bbe6-194b3d9f2ccd tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1751 microversion: 2.1 time: 0.177920 Sep 06 01:16:15.827504 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 379/733] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:15 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1751 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:16:15.898619 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6c30c3df-3b2d-46f9-bb3a-f91f9a904a83 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:15.899641 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6c30c3df-3b2d-46f9-bb3a-f91f9a904a83 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:15.907356 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c30c3df-3b2d-46f9-bb3a-f91f9a904a83 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:15.907867 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c30c3df-3b2d-46f9-bb3a-f91f9a904a83 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:15.908343 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c30c3df-3b2d-46f9-bb3a-f91f9a904a83 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:15.909001 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c30c3df-3b2d-46f9-bb3a-f91f9a904a83 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:15.909456 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c30c3df-3b2d-46f9-bb3a-f91f9a904a83 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:15.909881 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c30c3df-3b2d-46f9-bb3a-f91f9a904a83 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:16.088649 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-6c30c3df-3b2d-46f9-bb3a-f91f9a904a83 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:16.096865 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6c30c3df-3b2d-46f9-bb3a-f91f9a904a83 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1736 microversion: 2.1 time: 0.204022 Sep 06 01:16:16.112344 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 355/734] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:15 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:16.122698 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-b660d37a-b2d4-4e7b-b28f-9dbf92e5c2f3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:16.123325 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-b660d37a-b2d4-4e7b-b28f-9dbf92e5c2f3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:16.130091 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b660d37a-b2d4-4e7b-b28f-9dbf92e5c2f3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:16.130766 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b660d37a-b2d4-4e7b-b28f-9dbf92e5c2f3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:16.131236 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b660d37a-b2d4-4e7b-b28f-9dbf92e5c2f3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:16.131925 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b660d37a-b2d4-4e7b-b28f-9dbf92e5c2f3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:16.132545 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b660d37a-b2d4-4e7b-b28f-9dbf92e5c2f3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:16.132973 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b660d37a-b2d4-4e7b-b28f-9dbf92e5c2f3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:16.199486 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-b660d37a-b2d4-4e7b-b28f-9dbf92e5c2f3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:16.208675 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-b660d37a-b2d4-4e7b-b28f-9dbf92e5c2f3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:16.210488 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-b660d37a-b2d4-4e7b-b28f-9dbf92e5c2f3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:16.211843 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-b660d37a-b2d4-4e7b-b28f-9dbf92e5c2f3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1351 microversion: 2.20 time: 0.093252 Sep 06 01:16:16.212520 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 380/735] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:16:16 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1351 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:16:16.851264 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-40c2472f-7127-43ee-b793-47d0546ff88a tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:16.852038 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-40c2472f-7127-43ee-b793-47d0546ff88a tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:16.858243 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40c2472f-7127-43ee-b793-47d0546ff88a tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:16.858807 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40c2472f-7127-43ee-b793-47d0546ff88a tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:16.859316 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40c2472f-7127-43ee-b793-47d0546ff88a tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:16.860291 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40c2472f-7127-43ee-b793-47d0546ff88a tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:16.860822 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40c2472f-7127-43ee-b793-47d0546ff88a tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:16.861317 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40c2472f-7127-43ee-b793-47d0546ff88a tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:17.028300 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-40c2472f-7127-43ee-b793-47d0546ff88a tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:17.037506 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-40c2472f-7127-43ee-b793-47d0546ff88a tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1756 microversion: 2.1 time: 0.190798 Sep 06 01:16:17.038241 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 356/736] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:16 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1756 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:17.125156 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-0b0fe4c3-32af-494c-aff3-78582fd0bd60 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:17.126439 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-0b0fe4c3-32af-494c-aff3-78582fd0bd60 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:17.136443 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0b0fe4c3-32af-494c-aff3-78582fd0bd60 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:17.137316 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0b0fe4c3-32af-494c-aff3-78582fd0bd60 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:17.137961 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0b0fe4c3-32af-494c-aff3-78582fd0bd60 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:17.138922 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0b0fe4c3-32af-494c-aff3-78582fd0bd60 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:17.139782 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0b0fe4c3-32af-494c-aff3-78582fd0bd60 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:17.140523 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0b0fe4c3-32af-494c-aff3-78582fd0bd60 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:17.157528 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-738b6f02-b514-4c14-b155-9e559ac302d6 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:16:17.164489 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-738b6f02-b514-4c14-b155-9e559ac302d6 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:17.165288 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-738b6f02-b514-4c14-b155-9e559ac302d6 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:17.165902 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-738b6f02-b514-4c14-b155-9e559ac302d6 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:17.193521 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-738b6f02-b514-4c14-b155-9e559ac302d6 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Going to try to stop instance {{(pid=120581) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 06 01:16:17.281663 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-738b6f02-b514-4c14-b155-9e559ac302d6 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "POST /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba/action" status: 202 len: 0 microversion: 2.1 time: 0.127772 Sep 06 01:16:17.282282 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 357/737] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Sep 6 01:16:17 2022] POST /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 01:16:17.288465 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a74feec7-3641-4680-9881-556b966d5b7b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:17.289400 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a74feec7-3641-4680-9881-556b966d5b7b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:17.297382 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a74feec7-3641-4680-9881-556b966d5b7b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:17.298171 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a74feec7-3641-4680-9881-556b966d5b7b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:17.298605 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a74feec7-3641-4680-9881-556b966d5b7b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:17.299495 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a74feec7-3641-4680-9881-556b966d5b7b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:17.300121 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a74feec7-3641-4680-9881-556b966d5b7b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:17.300719 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a74feec7-3641-4680-9881-556b966d5b7b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:17.347840 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-0b0fe4c3-32af-494c-aff3-78582fd0bd60 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:17.356675 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-0b0fe4c3-32af-494c-aff3-78582fd0bd60 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1736 microversion: 2.1 time: 0.239604 Sep 06 01:16:17.357355 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 381/738] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:17 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1736 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:17.368146 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-786f5b36-98fb-4f29-8f28-a57486a0d48a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:17.369092 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-786f5b36-98fb-4f29-8f28-a57486a0d48a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:17.376168 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-786f5b36-98fb-4f29-8f28-a57486a0d48a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:17.376946 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-786f5b36-98fb-4f29-8f28-a57486a0d48a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:17.377611 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-786f5b36-98fb-4f29-8f28-a57486a0d48a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:17.379146 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-786f5b36-98fb-4f29-8f28-a57486a0d48a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:17.379980 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-786f5b36-98fb-4f29-8f28-a57486a0d48a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:17.380413 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-786f5b36-98fb-4f29-8f28-a57486a0d48a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:17.510940 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-a74feec7-3641-4680-9881-556b966d5b7b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:17.529079 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-a74feec7-3641-4680-9881-556b966d5b7b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:17.531856 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-a74feec7-3641-4680-9881-556b966d5b7b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:17.533192 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a74feec7-3641-4680-9881-556b966d5b7b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1407 microversion: 2.20 time: 0.249665 Sep 06 01:16:17.535070 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 358/739] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:16:17 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1407 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:16:17.582351 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-786f5b36-98fb-4f29-8f28-a57486a0d48a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:17.590766 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-786f5b36-98fb-4f29-8f28-a57486a0d48a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1676 microversion: 2.1 time: 0.232089 Sep 06 01:16:17.591337 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 382/740] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:17 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1676 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:18.062296 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4c355d35-918f-4afc-ae91-f20c3c43f75f tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:18.062813 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4c355d35-918f-4afc-ae91-f20c3c43f75f tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:18.069073 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c355d35-918f-4afc-ae91-f20c3c43f75f tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:18.069549 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c355d35-918f-4afc-ae91-f20c3c43f75f tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:18.069982 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c355d35-918f-4afc-ae91-f20c3c43f75f tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:18.070670 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c355d35-918f-4afc-ae91-f20c3c43f75f tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:18.071117 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c355d35-918f-4afc-ae91-f20c3c43f75f tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:18.071535 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c355d35-918f-4afc-ae91-f20c3c43f75f tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:18.107153 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-bb6f0852-1267-4bce-a0fe-276db47c6a80 req-b621b2cf-7a99-4073-8931-b654abebf6df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "366390df-669b-48b1-b741-56d5fdd64441", "tag": "703a4acd-427c-4fd4-bf73-f445a5bcac26"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:16:18.118589 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-bb6f0852-1267-4bce-a0fe-276db47c6a80 req-b621b2cf-7a99-4073-8931-b654abebf6df service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:18.119305 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-bb6f0852-1267-4bce-a0fe-276db47c6a80 req-b621b2cf-7a99-4073-8931-b654abebf6df service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:18.119935 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-bb6f0852-1267-4bce-a0fe-276db47c6a80 req-b621b2cf-7a99-4073-8931-b654abebf6df service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:18.132601 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.compute.server_external_events [req-bb6f0852-1267-4bce-a0fe-276db47c6a80 req-b621b2cf-7a99-4073-8931-b654abebf6df service nova] Creating event network-changed:703a4acd-427c-4fd4-bf73-f445a5bcac26 for instance 366390df-669b-48b1-b741-56d5fdd64441 on hv-cinder-84773 Sep 06 01:16:18.138729 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [req-bb6f0852-1267-4bce-a0fe-276db47c6a80 req-b621b2cf-7a99-4073-8931-b654abebf6df service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036148 Sep 06 01:16:18.139853 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 383/741] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:16:18.234764 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-4c355d35-918f-4afc-ae91-f20c3c43f75f tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:18.242992 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4c355d35-918f-4afc-ae91-f20c3c43f75f tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1756 microversion: 2.1 time: 0.184697 Sep 06 01:16:18.243564 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 359/742] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:18 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:18.380968 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-b04d8c81-dacb-4164-8704-a45510b15f6b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:18.381680 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-b04d8c81-dacb-4164-8704-a45510b15f6b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:18.387676 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b04d8c81-dacb-4164-8704-a45510b15f6b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:18.388199 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b04d8c81-dacb-4164-8704-a45510b15f6b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:18.388635 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b04d8c81-dacb-4164-8704-a45510b15f6b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:18.389375 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b04d8c81-dacb-4164-8704-a45510b15f6b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:18.389812 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b04d8c81-dacb-4164-8704-a45510b15f6b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:18.390236 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b04d8c81-dacb-4164-8704-a45510b15f6b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:18.521393 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-b04d8c81-dacb-4164-8704-a45510b15f6b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:18.529475 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-b04d8c81-dacb-4164-8704-a45510b15f6b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1716 microversion: 2.1 time: 0.152783 Sep 06 01:16:18.530213 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 384/743] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:18 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1716 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:18.560734 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d012c18d-dfe3-4fc2-8767-bc6c8fce47ce tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:18.561346 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d012c18d-dfe3-4fc2-8767-bc6c8fce47ce tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:18.571852 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d012c18d-dfe3-4fc2-8767-bc6c8fce47ce tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:18.572344 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d012c18d-dfe3-4fc2-8767-bc6c8fce47ce tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:18.572777 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d012c18d-dfe3-4fc2-8767-bc6c8fce47ce tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:18.573475 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d012c18d-dfe3-4fc2-8767-bc6c8fce47ce tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:18.573922 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d012c18d-dfe3-4fc2-8767-bc6c8fce47ce tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:18.574423 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d012c18d-dfe3-4fc2-8767-bc6c8fce47ce tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:18.615955 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-12088ada-a9fe-431e-af46-f0180858047b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:18.616933 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-12088ada-a9fe-431e-af46-f0180858047b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:18.624771 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-12088ada-a9fe-431e-af46-f0180858047b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:18.625584 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-12088ada-a9fe-431e-af46-f0180858047b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:18.626021 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-12088ada-a9fe-431e-af46-f0180858047b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:18.626903 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-12088ada-a9fe-431e-af46-f0180858047b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:18.627352 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-12088ada-a9fe-431e-af46-f0180858047b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:18.628118 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-12088ada-a9fe-431e-af46-f0180858047b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:18.763629 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-d012c18d-dfe3-4fc2-8767-bc6c8fce47ce tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:18.772291 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-d012c18d-dfe3-4fc2-8767-bc6c8fce47ce tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:18.773732 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-d012c18d-dfe3-4fc2-8767-bc6c8fce47ce tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:18.774829 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d012c18d-dfe3-4fc2-8767-bc6c8fce47ce tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1407 microversion: 2.20 time: 0.218990 Sep 06 01:16:18.775375 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 360/744] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:16:18 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:16:18.780079 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-30079381-09ce-4bcd-88c6-9705740bbbaf tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:18.780748 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-30079381-09ce-4bcd-88c6-9705740bbbaf tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:18.786437 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30079381-09ce-4bcd-88c6-9705740bbbaf tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:18.786922 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30079381-09ce-4bcd-88c6-9705740bbbaf tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:18.787355 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30079381-09ce-4bcd-88c6-9705740bbbaf tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:18.788074 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30079381-09ce-4bcd-88c6-9705740bbbaf tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:18.788527 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30079381-09ce-4bcd-88c6-9705740bbbaf tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:18.789005 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30079381-09ce-4bcd-88c6-9705740bbbaf tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:18.791274 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-12088ada-a9fe-431e-af46-f0180858047b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:18.799577 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-12088ada-a9fe-431e-af46-f0180858047b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1676 microversion: 2.1 time: 0.189658 Sep 06 01:16:18.800257 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 385/745] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:18 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1676 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:16:18.868528 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-30079381-09ce-4bcd-88c6-9705740bbbaf tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] HTTP exception thrown: Cannot 'detach_volume' instance ce3f054d-45b3-41c2-9f87-c32efa7bc088 while it is in vm_state rescued Sep 06 01:16:18.870073 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-30079381-09ce-4bcd-88c6-9705740bbbaf tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Request method failure captured: Sep 06 01:16:18.870073 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088/os-volume_attachments/e5c8d087-d284-4a06-9778-63333c2d17cd HTTP/1.1 Sep 06 01:16:18.870073 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept: application/json Sep 06 01:16:18.870073 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept-Encoding: identity Sep 06 01:16:18.870073 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Connection: close Sep 06 01:16:18.870073 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Length: 0 Sep 06 01:16:18.870073 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Type: application/json Sep 06 01:16:18.870073 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Host: 10.222.0.23 Sep 06 01:16:18.870073 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Openstack-System-Scope: None Sep 06 01:16:18.870073 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Sep 06 01:16:18.870073 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjFp5NMcwKuEUHo2486ufaQ1_DZDxLGpUTLrr7cY7CHRRWjkMwkS2RH-midIYAwqOB5ZPR8PbCADD5XlDFDs-1j0nZ0VMlxZ2i03OyHDj--OqiIIDDm8dNS5bEMfqSgxwbC1vfe-w2IKMjXfHxinzodZYhHEbGdxznmqwbs3qXAmEUuhE Sep 06 01:16:18.870073 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Id: None Sep 06 01:16:18.870073 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Name: None Sep 06 01:16:18.870073 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Identity-Status: Confirmed Sep 06 01:16:18.870073 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Is-Admin-Project: True Sep 06 01:16:18.870073 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Id: default Sep 06 01:16:18.870073 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Name: Default Sep 06 01:16:18.870073 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Id: 91ee5ad0b4064b9d8a038980786072cb Sep 06 01:16:18.870073 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-317724904 Sep 06 01:16:18.870073 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Role: reader,member Sep 06 01:16:18.870073 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Roles: reader,member Sep 06 01:16:18.871586 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ee5ad0b4064b9d8a038980786072cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/91ee5ad0b4064b9d8a038980786072cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_91ee5ad0b4064b9d8a038980786072cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ee5ad0b4064b9d8a038980786072cb"}]}] Sep 06 01:16:18.871586 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant: tempest-ServerRescueNegativeTestJSON-317724904 Sep 06 01:16:18.871586 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Id: 91ee5ad0b4064b9d8a038980786072cb Sep 06 01:16:18.871586 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-317724904 Sep 06 01:16:18.871586 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User: tempest-ServerRescueNegativeTestJSON-317724904-project Sep 06 01:16:18.871586 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Id: default Sep 06 01:16:18.871586 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Name: Default Sep 06 01:16:18.871586 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Id: 703464e4a9524efaa8fdfc1870158cbb Sep 06 01:16:18.871586 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Name: tempest-ServerRescueNegativeTestJSON-317724904-project Sep 06 01:16:18.871586 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: method: > Sep 06 01:16:18.871586 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: exception: Cannot 'detach_volume' instance ce3f054d-45b3-41c2-9f87-c32efa7bc088 while it is in vm_state rescued Sep 06 01:16:18.872486 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: action_args: {'server_id': 'ce3f054d-45b3-41c2-9f87-c32efa7bc088', 'id': 'e5c8d087-d284-4a06-9778-63333c2d17cd'} Sep 06 01:16:18.872486 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:16:18.872486 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:16:18.872486 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 06 01:16:18.872486 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 06 01:16:18.872486 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 01:16:18.872486 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 01:16:18.872486 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 06 01:16:18.872486 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 06 01:16:18.872486 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ce3f054d-45b3-41c2-9f87-c32efa7bc088 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 06 01:16:18.872486 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:16:18.872486 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:16:18.872486 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:16:18.872486 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:16:18.872486 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:16:18.872486 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:16:18.872486 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:16:18.872486 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:16:18.872486 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:16:18.872486 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:16:18.874085 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 06 01:16:18.874085 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 06 01:16:18.874085 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 06 01:16:18.874085 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 06 01:16:18.874085 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance ce3f054d-45b3-41c2-9f87-c32efa7bc088 while it is in vm_state rescued Sep 06 01:16:18.874085 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:16:18.874085 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:16:18.874085 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:16:18.874085 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:16:18.874085 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:16:18.874085 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:16:18.874085 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:16:18.874085 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:16:18.874085 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance ce3f054d-45b3-41c2-9f87-c32efa7bc088 while it is in vm_state rescued Sep 06 01:16:18.874085 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:16:18.874085 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-30079381-09ce-4bcd-88c6-9705740bbbaf tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Returning 409 to user: Cannot 'detach_volume' instance ce3f054d-45b3-41c2-9f87-c32efa7bc088 while it is in vm_state rescued {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:16:18.875292 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-30079381-09ce-4bcd-88c6-9705740bbbaf tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088/os-volume_attachments/e5c8d087-d284-4a06-9778-63333c2d17cd" status: 409 len: 152 microversion: 2.1 time: 0.094985 Sep 06 01:16:18.875292 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 361/746] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Sep 6 01:16:18 2022] DELETE /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088/os-volume_attachments/e5c8d087-d284-4a06-9778-63333c2d17cd => generated 152 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 06 01:16:18.881026 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-4b19bfe9-6f07-4815-ad47-31730ec273ca tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:16:18.881615 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-4b19bfe9-6f07-4815-ad47-31730ec273ca tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:18.887361 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4b19bfe9-6f07-4815-ad47-31730ec273ca tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:18.887876 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4b19bfe9-6f07-4815-ad47-31730ec273ca tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:18.888303 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4b19bfe9-6f07-4815-ad47-31730ec273ca tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:18.888980 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4b19bfe9-6f07-4815-ad47-31730ec273ca tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:18.889427 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4b19bfe9-6f07-4815-ad47-31730ec273ca tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:18.889844 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4b19bfe9-6f07-4815-ad47-31730ec273ca tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:18.953850 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-4b19bfe9-6f07-4815-ad47-31730ec273ca tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "POST /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088/action" status: 202 len: 0 microversion: 2.1 time: 0.076989 Sep 06 01:16:18.954474 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 386/747] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Sep 6 01:16:18 2022] POST /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 01:16:18.962523 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-05e6990d-48ba-40e8-977a-f3e77eb6b2b7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:18.963140 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-05e6990d-48ba-40e8-977a-f3e77eb6b2b7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:18.969087 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05e6990d-48ba-40e8-977a-f3e77eb6b2b7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:18.969571 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05e6990d-48ba-40e8-977a-f3e77eb6b2b7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:18.970010 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05e6990d-48ba-40e8-977a-f3e77eb6b2b7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:18.970694 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05e6990d-48ba-40e8-977a-f3e77eb6b2b7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:18.971157 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05e6990d-48ba-40e8-977a-f3e77eb6b2b7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:18.971583 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05e6990d-48ba-40e8-977a-f3e77eb6b2b7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:19.098019 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-05e6990d-48ba-40e8-977a-f3e77eb6b2b7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:19.106476 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-05e6990d-48ba-40e8-977a-f3e77eb6b2b7 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1724 microversion: 2.1 time: 0.147795 Sep 06 01:16:19.107034 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 362/748] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:18 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:19.266615 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-e29afca9-89ca-47d2-8cbb-24f5df1159b2 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:19.267303 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-e29afca9-89ca-47d2-8cbb-24f5df1159b2 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:19.274104 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e29afca9-89ca-47d2-8cbb-24f5df1159b2 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:19.274825 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e29afca9-89ca-47d2-8cbb-24f5df1159b2 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:19.275451 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e29afca9-89ca-47d2-8cbb-24f5df1159b2 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:19.276181 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e29afca9-89ca-47d2-8cbb-24f5df1159b2 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:19.276634 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e29afca9-89ca-47d2-8cbb-24f5df1159b2 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:19.277289 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e29afca9-89ca-47d2-8cbb-24f5df1159b2 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:19.421714 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-e29afca9-89ca-47d2-8cbb-24f5df1159b2 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:19.430219 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-e29afca9-89ca-47d2-8cbb-24f5df1159b2 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1756 microversion: 2.1 time: 0.168305 Sep 06 01:16:19.430777 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 387/749] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:19 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:19.799576 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b848cf78-f86c-4f9f-8edd-3edfad9916e6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:19.800376 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b848cf78-f86c-4f9f-8edd-3edfad9916e6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:19.806566 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b848cf78-f86c-4f9f-8edd-3edfad9916e6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:19.807053 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b848cf78-f86c-4f9f-8edd-3edfad9916e6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:19.807481 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b848cf78-f86c-4f9f-8edd-3edfad9916e6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:19.808189 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b848cf78-f86c-4f9f-8edd-3edfad9916e6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:19.808634 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b848cf78-f86c-4f9f-8edd-3edfad9916e6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:19.809050 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b848cf78-f86c-4f9f-8edd-3edfad9916e6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:19.822167 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-67c3b63e-d7f8-4784-9b6d-6ee24c7d8eb4 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:19.822773 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-67c3b63e-d7f8-4784-9b6d-6ee24c7d8eb4 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:19.828793 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-67c3b63e-d7f8-4784-9b6d-6ee24c7d8eb4 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:19.829280 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-67c3b63e-d7f8-4784-9b6d-6ee24c7d8eb4 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:19.829715 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-67c3b63e-d7f8-4784-9b6d-6ee24c7d8eb4 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:19.830406 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-67c3b63e-d7f8-4784-9b6d-6ee24c7d8eb4 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:19.830858 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-67c3b63e-d7f8-4784-9b6d-6ee24c7d8eb4 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:19.831282 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-67c3b63e-d7f8-4784-9b6d-6ee24c7d8eb4 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:20.007308 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-b848cf78-f86c-4f9f-8edd-3edfad9916e6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:20.016158 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-b848cf78-f86c-4f9f-8edd-3edfad9916e6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:20.017454 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-b848cf78-f86c-4f9f-8edd-3edfad9916e6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:20.018575 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b848cf78-f86c-4f9f-8edd-3edfad9916e6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1407 microversion: 2.20 time: 0.222961 Sep 06 01:16:20.020022 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 363/750] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:16:19 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1407 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:16:20.021173 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-67c3b63e-d7f8-4784-9b6d-6ee24c7d8eb4 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:20.031169 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-67c3b63e-d7f8-4784-9b6d-6ee24c7d8eb4 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1676 microversion: 2.1 time: 0.212647 Sep 06 01:16:20.031952 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 388/751] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:19 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1676 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:16:20.130679 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e17a2dc7-5b17-4b71-b983-6ff56fbf353c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:20.131433 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e17a2dc7-5b17-4b71-b983-6ff56fbf353c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:20.137726 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e17a2dc7-5b17-4b71-b983-6ff56fbf353c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:20.138211 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e17a2dc7-5b17-4b71-b983-6ff56fbf353c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:20.138642 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e17a2dc7-5b17-4b71-b983-6ff56fbf353c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:20.139328 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e17a2dc7-5b17-4b71-b983-6ff56fbf353c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:20.139798 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e17a2dc7-5b17-4b71-b983-6ff56fbf353c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:20.140219 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e17a2dc7-5b17-4b71-b983-6ff56fbf353c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:20.267698 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-e17a2dc7-5b17-4b71-b983-6ff56fbf353c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:20.276449 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e17a2dc7-5b17-4b71-b983-6ff56fbf353c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1724 microversion: 2.1 time: 0.150120 Sep 06 01:16:20.277025 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 364/752] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:20 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:20.453924 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-62882016-3152-42ba-a4a3-b42895c187ba tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:20.454540 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-62882016-3152-42ba-a4a3-b42895c187ba tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:20.461096 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-62882016-3152-42ba-a4a3-b42895c187ba tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:20.461542 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-62882016-3152-42ba-a4a3-b42895c187ba tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:20.461981 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-62882016-3152-42ba-a4a3-b42895c187ba tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:20.462676 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-62882016-3152-42ba-a4a3-b42895c187ba tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:20.463132 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-62882016-3152-42ba-a4a3-b42895c187ba tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:20.463562 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-62882016-3152-42ba-a4a3-b42895c187ba tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:20.602414 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-62882016-3152-42ba-a4a3-b42895c187ba tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:20.610852 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-62882016-3152-42ba-a4a3-b42895c187ba tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1756 microversion: 2.1 time: 0.160781 Sep 06 01:16:20.611449 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 389/753] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:20 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:21.044888 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7715ab5a-7d92-4a57-924e-0b90ebc06532 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:21.045498 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7715ab5a-7d92-4a57-924e-0b90ebc06532 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:21.052055 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7715ab5a-7d92-4a57-924e-0b90ebc06532 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:21.052541 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7715ab5a-7d92-4a57-924e-0b90ebc06532 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:21.053128 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7715ab5a-7d92-4a57-924e-0b90ebc06532 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:21.053812 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7715ab5a-7d92-4a57-924e-0b90ebc06532 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:21.054265 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7715ab5a-7d92-4a57-924e-0b90ebc06532 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:21.054688 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7715ab5a-7d92-4a57-924e-0b90ebc06532 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:21.058200 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-39a46ebd-5e7f-4050-bb35-508cffb739ba tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:21.058814 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-39a46ebd-5e7f-4050-bb35-508cffb739ba tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:21.064614 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-39a46ebd-5e7f-4050-bb35-508cffb739ba tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:21.065104 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-39a46ebd-5e7f-4050-bb35-508cffb739ba tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:21.065562 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-39a46ebd-5e7f-4050-bb35-508cffb739ba tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:21.066274 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-39a46ebd-5e7f-4050-bb35-508cffb739ba tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:21.066729 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-39a46ebd-5e7f-4050-bb35-508cffb739ba tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:21.067182 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-39a46ebd-5e7f-4050-bb35-508cffb739ba tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:21.249136 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-7715ab5a-7d92-4a57-924e-0b90ebc06532 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:21.255910 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-39a46ebd-5e7f-4050-bb35-508cffb739ba tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:21.258015 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-7715ab5a-7d92-4a57-924e-0b90ebc06532 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:21.259668 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-7715ab5a-7d92-4a57-924e-0b90ebc06532 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:21.260827 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7715ab5a-7d92-4a57-924e-0b90ebc06532 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1407 microversion: 2.20 time: 0.220207 Sep 06 01:16:21.261384 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 365/754] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:16:21 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:16:21.263629 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-39a46ebd-5e7f-4050-bb35-508cffb739ba tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1676 microversion: 2.1 time: 0.209186 Sep 06 01:16:21.264216 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 390/755] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:21 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1676 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:16:21.298610 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-96c2688f-9e93-429e-b57c-386b0f062078 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:21.299146 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-96c2688f-9e93-429e-b57c-386b0f062078 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:21.301113 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:16:21.306268 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-96c2688f-9e93-429e-b57c-386b0f062078 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:21.306740 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-96c2688f-9e93-429e-b57c-386b0f062078 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:21.307171 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-96c2688f-9e93-429e-b57c-386b0f062078 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:21.307876 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-96c2688f-9e93-429e-b57c-386b0f062078 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:21.308328 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-96c2688f-9e93-429e-b57c-386b0f062078 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:21.308749 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-96c2688f-9e93-429e-b57c-386b0f062078 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:21.439573 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-96c2688f-9e93-429e-b57c-386b0f062078 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:21.447883 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-96c2688f-9e93-429e-b57c-386b0f062078 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1724 microversion: 2.1 time: 0.153162 Sep 06 01:16:21.448442 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 366/756] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:21 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:21.634879 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-badde669-5f76-4f77-ae18-7e6b1b0a404a tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:21.635508 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-badde669-5f76-4f77-ae18-7e6b1b0a404a tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:21.641846 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-badde669-5f76-4f77-ae18-7e6b1b0a404a tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:21.642325 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-badde669-5f76-4f77-ae18-7e6b1b0a404a tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:21.642754 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-badde669-5f76-4f77-ae18-7e6b1b0a404a tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:21.643436 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-badde669-5f76-4f77-ae18-7e6b1b0a404a tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:21.644466 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-badde669-5f76-4f77-ae18-7e6b1b0a404a tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:21.644892 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-badde669-5f76-4f77-ae18-7e6b1b0a404a tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:21.784300 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-badde669-5f76-4f77-ae18-7e6b1b0a404a tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:21.794064 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-badde669-5f76-4f77-ae18-7e6b1b0a404a tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1756 microversion: 2.1 time: 0.162877 Sep 06 01:16:21.794683 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 391/757] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:21 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:22.287087 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4098506f-c31f-483c-90a9-69139704f146 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:22.287634 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-0ba7d9ad-bc55-4810-8305-fa5564fa2c78 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:22.287810 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4098506f-c31f-483c-90a9-69139704f146 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:22.288430 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-0ba7d9ad-bc55-4810-8305-fa5564fa2c78 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:22.294885 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4098506f-c31f-483c-90a9-69139704f146 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:22.295040 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0ba7d9ad-bc55-4810-8305-fa5564fa2c78 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:22.295375 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4098506f-c31f-483c-90a9-69139704f146 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:22.295488 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0ba7d9ad-bc55-4810-8305-fa5564fa2c78 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:22.295847 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4098506f-c31f-483c-90a9-69139704f146 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:22.295960 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0ba7d9ad-bc55-4810-8305-fa5564fa2c78 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:22.296549 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4098506f-c31f-483c-90a9-69139704f146 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:22.296657 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0ba7d9ad-bc55-4810-8305-fa5564fa2c78 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:22.297003 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0ba7d9ad-bc55-4810-8305-fa5564fa2c78 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:22.297101 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4098506f-c31f-483c-90a9-69139704f146 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:22.297427 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4098506f-c31f-483c-90a9-69139704f146 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:22.297520 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0ba7d9ad-bc55-4810-8305-fa5564fa2c78 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:22.302253 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:16:22.488210 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-0ba7d9ad-bc55-4810-8305-fa5564fa2c78 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:22.491587 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-4098506f-c31f-483c-90a9-69139704f146 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:22.497097 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-0ba7d9ad-bc55-4810-8305-fa5564fa2c78 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:22.498629 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-0ba7d9ad-bc55-4810-8305-fa5564fa2c78 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:22.499276 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4098506f-c31f-483c-90a9-69139704f146 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1676 microversion: 2.1 time: 0.216673 Sep 06 01:16:22.499871 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 367/758] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:22 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1676 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:22.499983 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-0ba7d9ad-bc55-4810-8305-fa5564fa2c78 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1407 microversion: 2.20 time: 0.217213 Sep 06 01:16:22.500766 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 392/759] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:16:22 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:16:22.504744 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ed6c9a4e-f463-4816-b24d-374c89c9660e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:22.505347 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ed6c9a4e-f463-4816-b24d-374c89c9660e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:22.510846 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ed6c9a4e-f463-4816-b24d-374c89c9660e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:22.511346 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ed6c9a4e-f463-4816-b24d-374c89c9660e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:22.511786 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ed6c9a4e-f463-4816-b24d-374c89c9660e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:22.512480 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ed6c9a4e-f463-4816-b24d-374c89c9660e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:22.512975 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ed6c9a4e-f463-4816-b24d-374c89c9660e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:22.513354 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ed6c9a4e-f463-4816-b24d-374c89c9660e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:22.640850 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-ed6c9a4e-f463-4816-b24d-374c89c9660e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:22.649502 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ed6c9a4e-f463-4816-b24d-374c89c9660e tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1730 microversion: 2.1 time: 0.148682 Sep 06 01:16:22.650253 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 368/760] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:22 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:22.673219 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-52930156-0ec4-4491-976e-cb68a5830e68 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:22.673752 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-52930156-0ec4-4491-976e-cb68a5830e68 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:22.679665 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-52930156-0ec4-4491-976e-cb68a5830e68 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:22.680185 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-52930156-0ec4-4491-976e-cb68a5830e68 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:22.680625 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-52930156-0ec4-4491-976e-cb68a5830e68 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:22.681316 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-52930156-0ec4-4491-976e-cb68a5830e68 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:22.681775 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-52930156-0ec4-4491-976e-cb68a5830e68 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:22.682201 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-52930156-0ec4-4491-976e-cb68a5830e68 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:22.759808 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-52930156-0ec4-4491-976e-cb68a5830e68 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090490 Sep 06 01:16:22.760403 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 393/761] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Sep 6 01:16:22 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:16:22.817384 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ed33d275-5b31-436e-bf36-7db11de33cc5 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:22.818131 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ed33d275-5b31-436e-bf36-7db11de33cc5 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:22.820245 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:16:22.821100 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=10 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:16:22.826894 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ed33d275-5b31-436e-bf36-7db11de33cc5 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:22.827388 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ed33d275-5b31-436e-bf36-7db11de33cc5 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:22.827858 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ed33d275-5b31-436e-bf36-7db11de33cc5 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:22.828576 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ed33d275-5b31-436e-bf36-7db11de33cc5 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:22.829035 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ed33d275-5b31-436e-bf36-7db11de33cc5 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:22.829463 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ed33d275-5b31-436e-bf36-7db11de33cc5 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:23.231883 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-ed33d275-5b31-436e-bf36-7db11de33cc5 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:23.240000 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ed33d275-5b31-436e-bf36-7db11de33cc5 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1756 microversion: 2.1 time: 0.426518 Sep 06 01:16:23.240560 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 369/762] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:22 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1756 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:23.519367 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell0:SELECT=2 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:16:23.524800 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-4604a3e8-136e-47d9-864f-be29691286ab tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:23.525417 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-4604a3e8-136e-47d9-864f-be29691286ab tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:23.535038 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cdf3f19a-914a-4096-b8b9-9e06d9144bd0 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:23.535702 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cdf3f19a-914a-4096-b8b9-9e06d9144bd0 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:23.542083 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4604a3e8-136e-47d9-864f-be29691286ab tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:23.542576 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4604a3e8-136e-47d9-864f-be29691286ab tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:23.543008 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4604a3e8-136e-47d9-864f-be29691286ab tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:23.543704 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4604a3e8-136e-47d9-864f-be29691286ab tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:23.544177 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4604a3e8-136e-47d9-864f-be29691286ab tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:23.544601 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4604a3e8-136e-47d9-864f-be29691286ab tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:23.552269 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cdf3f19a-914a-4096-b8b9-9e06d9144bd0 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:23.552961 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cdf3f19a-914a-4096-b8b9-9e06d9144bd0 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:23.554138 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cdf3f19a-914a-4096-b8b9-9e06d9144bd0 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:23.554999 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cdf3f19a-914a-4096-b8b9-9e06d9144bd0 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:23.556159 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cdf3f19a-914a-4096-b8b9-9e06d9144bd0 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:23.556736 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cdf3f19a-914a-4096-b8b9-9e06d9144bd0 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:23.825640 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-4604a3e8-136e-47d9-864f-be29691286ab tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:23.833552 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-4604a3e8-136e-47d9-864f-be29691286ab tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1676 microversion: 2.1 time: 0.315102 Sep 06 01:16:23.834124 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 394/763] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:23 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1676 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:23.838493 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-7af939b0-3f0b-41e6-969c-3016d82b7c5e req-d9716031-4f81-46f5-907b-83caf9025fb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "366390df-669b-48b1-b741-56d5fdd64441", "name": "network-vif-plugged", "status": "completed", "tag": "703a4acd-427c-4fd4-bf73-f445a5bcac26"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:16:23.848120 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-7af939b0-3f0b-41e6-969c-3016d82b7c5e req-d9716031-4f81-46f5-907b-83caf9025fb8 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:23.848604 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-7af939b0-3f0b-41e6-969c-3016d82b7c5e req-d9716031-4f81-46f5-907b-83caf9025fb8 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:23.849033 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-7af939b0-3f0b-41e6-969c-3016d82b7c5e req-d9716031-4f81-46f5-907b-83caf9025fb8 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:23.859679 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.compute.server_external_events [req-7af939b0-3f0b-41e6-969c-3016d82b7c5e req-d9716031-4f81-46f5-907b-83caf9025fb8 service nova] Creating event network-vif-plugged:703a4acd-427c-4fd4-bf73-f445a5bcac26 for instance 366390df-669b-48b1-b741-56d5fdd64441 on hv-cinder-84773 Sep 06 01:16:23.865103 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [req-7af939b0-3f0b-41e6-969c-3016d82b7c5e req-d9716031-4f81-46f5-907b-83caf9025fb8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029902 Sep 06 01:16:23.865680 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 395/764] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:16:23.888397 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-cdf3f19a-914a-4096-b8b9-9e06d9144bd0 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:23.898766 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-cdf3f19a-914a-4096-b8b9-9e06d9144bd0 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:23.900420 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-cdf3f19a-914a-4096-b8b9-9e06d9144bd0 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:23.902037 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cdf3f19a-914a-4096-b8b9-9e06d9144bd0 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1407 microversion: 2.20 time: 0.370830 Sep 06 01:16:23.903024 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 370/765] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:16:23 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1407 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:16:24.121110 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-3d4cea32-079c-443d-b6ca-ab69e8bbfd14 req-0681bc6b-fd5b-4059-86cf-15e1b6acc547 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce3f054d-45b3-41c2-9f87-c32efa7bc088", "tag": "5bfb66f4-238b-4ee5-8ff6-581b693fd4eb"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:16:24.130801 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-3d4cea32-079c-443d-b6ca-ab69e8bbfd14 req-0681bc6b-fd5b-4059-86cf-15e1b6acc547 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:24.131365 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-3d4cea32-079c-443d-b6ca-ab69e8bbfd14 req-0681bc6b-fd5b-4059-86cf-15e1b6acc547 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:24.131913 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-3d4cea32-079c-443d-b6ca-ab69e8bbfd14 req-0681bc6b-fd5b-4059-86cf-15e1b6acc547 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:24.143935 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.compute.server_external_events [req-3d4cea32-079c-443d-b6ca-ab69e8bbfd14 req-0681bc6b-fd5b-4059-86cf-15e1b6acc547 service nova] Creating event network-changed:5bfb66f4-238b-4ee5-8ff6-581b693fd4eb for instance ce3f054d-45b3-41c2-9f87-c32efa7bc088 on hv-cinder-84773 Sep 06 01:16:24.149949 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [req-3d4cea32-079c-443d-b6ca-ab69e8bbfd14 req-0681bc6b-fd5b-4059-86cf-15e1b6acc547 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032818 Sep 06 01:16:24.150716 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 396/766] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:16:24.263817 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1f39a1ab-1877-4ff9-8a74-8484862f52e3 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:24.264672 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1f39a1ab-1877-4ff9-8a74-8484862f52e3 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:24.271115 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f39a1ab-1877-4ff9-8a74-8484862f52e3 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:24.271598 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f39a1ab-1877-4ff9-8a74-8484862f52e3 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:24.272059 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f39a1ab-1877-4ff9-8a74-8484862f52e3 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:24.272826 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f39a1ab-1877-4ff9-8a74-8484862f52e3 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:24.273278 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f39a1ab-1877-4ff9-8a74-8484862f52e3 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:24.273700 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f39a1ab-1877-4ff9-8a74-8484862f52e3 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:24.420850 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-1f39a1ab-1877-4ff9-8a74-8484862f52e3 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:24.429403 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1f39a1ab-1877-4ff9-8a74-8484862f52e3 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1756 microversion: 2.1 time: 0.169463 Sep 06 01:16:24.430186 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 371/767] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:24 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:24.858864 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-8ba74e59-f08b-437b-aa11-b47631b60d81 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:24.859555 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-8ba74e59-f08b-437b-aa11-b47631b60d81 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:24.866280 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8ba74e59-f08b-437b-aa11-b47631b60d81 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:24.866699 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8ba74e59-f08b-437b-aa11-b47631b60d81 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:24.867131 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8ba74e59-f08b-437b-aa11-b47631b60d81 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:24.867836 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8ba74e59-f08b-437b-aa11-b47631b60d81 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:24.868290 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8ba74e59-f08b-437b-aa11-b47631b60d81 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:24.868709 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8ba74e59-f08b-437b-aa11-b47631b60d81 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:24.873119 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:16:24.928840 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8e152d19-5f43-418a-b1e7-ab46c3a7a9f6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:24.929764 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8e152d19-5f43-418a-b1e7-ab46c3a7a9f6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:24.935818 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8e152d19-5f43-418a-b1e7-ab46c3a7a9f6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:24.936550 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8e152d19-5f43-418a-b1e7-ab46c3a7a9f6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:24.936987 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8e152d19-5f43-418a-b1e7-ab46c3a7a9f6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:24.937705 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8e152d19-5f43-418a-b1e7-ab46c3a7a9f6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:24.938147 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8e152d19-5f43-418a-b1e7-ab46c3a7a9f6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:24.938568 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8e152d19-5f43-418a-b1e7-ab46c3a7a9f6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:25.050394 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-8ba74e59-f08b-437b-aa11-b47631b60d81 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:25.063229 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-8ba74e59-f08b-437b-aa11-b47631b60d81 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1676 microversion: 2.1 time: 0.208980 Sep 06 01:16:25.064344 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 397/768] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:24 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1676 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:25.120784 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-8e152d19-5f43-418a-b1e7-ab46c3a7a9f6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:25.131164 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-8e152d19-5f43-418a-b1e7-ab46c3a7a9f6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:25.132050 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-8e152d19-5f43-418a-b1e7-ab46c3a7a9f6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:25.133148 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8e152d19-5f43-418a-b1e7-ab46c3a7a9f6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1407 microversion: 2.20 time: 0.208829 Sep 06 01:16:25.133699 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 372/769] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:16:24 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:16:25.452646 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-856a48f3-5297-47e3-8e69-8a43adb38f7c tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:25.453256 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-856a48f3-5297-47e3-8e69-8a43adb38f7c tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:25.459860 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-856a48f3-5297-47e3-8e69-8a43adb38f7c tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:25.460339 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-856a48f3-5297-47e3-8e69-8a43adb38f7c tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:25.460769 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-856a48f3-5297-47e3-8e69-8a43adb38f7c tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:25.461452 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-856a48f3-5297-47e3-8e69-8a43adb38f7c tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:25.461903 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-856a48f3-5297-47e3-8e69-8a43adb38f7c tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:25.462325 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-856a48f3-5297-47e3-8e69-8a43adb38f7c tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:25.606374 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-856a48f3-5297-47e3-8e69-8a43adb38f7c tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:25.614561 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-856a48f3-5297-47e3-8e69-8a43adb38f7c tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1756 microversion: 2.1 time: 0.165682 Sep 06 01:16:25.615118 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 398/770] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:25 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:26.087502 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-42fdce21-a494-4607-8b4e-6ceaf738ba74 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:26.088088 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-42fdce21-a494-4607-8b4e-6ceaf738ba74 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:26.094416 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42fdce21-a494-4607-8b4e-6ceaf738ba74 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:26.094903 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42fdce21-a494-4607-8b4e-6ceaf738ba74 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:26.095340 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42fdce21-a494-4607-8b4e-6ceaf738ba74 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:26.096061 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42fdce21-a494-4607-8b4e-6ceaf738ba74 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:26.096517 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42fdce21-a494-4607-8b4e-6ceaf738ba74 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:26.096942 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42fdce21-a494-4607-8b4e-6ceaf738ba74 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:26.158297 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-4ce15a71-dcc3-4845-b113-190d062f4719 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:26.158937 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-4ce15a71-dcc3-4845-b113-190d062f4719 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:26.166031 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4ce15a71-dcc3-4845-b113-190d062f4719 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:26.166510 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4ce15a71-dcc3-4845-b113-190d062f4719 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:26.167201 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4ce15a71-dcc3-4845-b113-190d062f4719 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:26.168009 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4ce15a71-dcc3-4845-b113-190d062f4719 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:26.168461 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4ce15a71-dcc3-4845-b113-190d062f4719 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:26.168869 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4ce15a71-dcc3-4845-b113-190d062f4719 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:26.273544 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-42fdce21-a494-4607-8b4e-6ceaf738ba74 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:26.281436 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-42fdce21-a494-4607-8b4e-6ceaf738ba74 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1676 microversion: 2.1 time: 0.197890 Sep 06 01:16:26.282005 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 373/771] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:26 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1676 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:26.286875 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-2e0fe307-03a7-4e00-9487-8ceeecd833fe req-3401336a-8bdf-419b-8c4a-846f440f99e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce3f054d-45b3-41c2-9f87-c32efa7bc088", "tag": "5bfb66f4-238b-4ee5-8ff6-581b693fd4eb"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:16:26.296530 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-2e0fe307-03a7-4e00-9487-8ceeecd833fe req-3401336a-8bdf-419b-8c4a-846f440f99e4 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:26.297007 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-2e0fe307-03a7-4e00-9487-8ceeecd833fe req-3401336a-8bdf-419b-8c4a-846f440f99e4 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:26.297496 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-2e0fe307-03a7-4e00-9487-8ceeecd833fe req-3401336a-8bdf-419b-8c4a-846f440f99e4 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:26.309265 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-2e0fe307-03a7-4e00-9487-8ceeecd833fe req-3401336a-8bdf-419b-8c4a-846f440f99e4 service nova] Creating event network-changed:5bfb66f4-238b-4ee5-8ff6-581b693fd4eb for instance ce3f054d-45b3-41c2-9f87-c32efa7bc088 on hv-cinder-84773 Sep 06 01:16:26.314082 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-2e0fe307-03a7-4e00-9487-8ceeecd833fe req-3401336a-8bdf-419b-8c4a-846f440f99e4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030994 Sep 06 01:16:26.314667 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 374/772] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:16:26.320104 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-4ce15a71-dcc3-4845-b113-190d062f4719 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:26.328710 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-4ce15a71-dcc3-4845-b113-190d062f4719 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:26.330136 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-4ce15a71-dcc3-4845-b113-190d062f4719 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:26.331280 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-4ce15a71-dcc3-4845-b113-190d062f4719 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1599 microversion: 2.20 time: 0.176926 Sep 06 01:16:26.331846 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 399/773] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:16:26 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1599 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:16:26.356339 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6de9dcdb-4c20-4c7f-8d4b-a44164f7083c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:26.357022 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6de9dcdb-4c20-4c7f-8d4b-a44164f7083c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:26.364026 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6de9dcdb-4c20-4c7f-8d4b-a44164f7083c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:26.364507 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6de9dcdb-4c20-4c7f-8d4b-a44164f7083c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:26.364936 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6de9dcdb-4c20-4c7f-8d4b-a44164f7083c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:26.365621 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6de9dcdb-4c20-4c7f-8d4b-a44164f7083c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:26.366068 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6de9dcdb-4c20-4c7f-8d4b-a44164f7083c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:26.366483 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6de9dcdb-4c20-4c7f-8d4b-a44164f7083c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:26.442105 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6de9dcdb-4c20-4c7f-8d4b-a44164f7083c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.090127 Sep 06 01:16:26.442782 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 375/774] 10.222.0.23 () {60 vars in 1316 bytes} [Tue Sep 6 01:16:26 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 01:16:26.638075 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-22a7fe83-c2c3-4274-9f0f-39042195d57e tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:26.639165 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-22a7fe83-c2c3-4274-9f0f-39042195d57e tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:26.645639 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-22a7fe83-c2c3-4274-9f0f-39042195d57e tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:26.645769 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-22a7fe83-c2c3-4274-9f0f-39042195d57e tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:26.646161 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-22a7fe83-c2c3-4274-9f0f-39042195d57e tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:26.646859 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-22a7fe83-c2c3-4274-9f0f-39042195d57e tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:26.647310 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-22a7fe83-c2c3-4274-9f0f-39042195d57e tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:26.647737 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-22a7fe83-c2c3-4274-9f0f-39042195d57e tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:27.090160 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-22a7fe83-c2c3-4274-9f0f-39042195d57e tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:27.098295 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-22a7fe83-c2c3-4274-9f0f-39042195d57e tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1756 microversion: 2.1 time: 0.464040 Sep 06 01:16:27.098866 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 400/775] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:26 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1756 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:27.307298 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1a3c9ee7-8ab6-4b38-b9ac-c0dc7e04bdfa tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:27.307951 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1a3c9ee7-8ab6-4b38-b9ac-c0dc7e04bdfa tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:27.315489 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a3c9ee7-8ab6-4b38-b9ac-c0dc7e04bdfa tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:27.316929 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a3c9ee7-8ab6-4b38-b9ac-c0dc7e04bdfa tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:27.317379 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a3c9ee7-8ab6-4b38-b9ac-c0dc7e04bdfa tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:27.318090 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a3c9ee7-8ab6-4b38-b9ac-c0dc7e04bdfa tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:27.318558 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a3c9ee7-8ab6-4b38-b9ac-c0dc7e04bdfa tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:27.318988 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a3c9ee7-8ab6-4b38-b9ac-c0dc7e04bdfa tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:27.536377 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-1a3c9ee7-8ab6-4b38-b9ac-c0dc7e04bdfa tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:27.546518 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1a3c9ee7-8ab6-4b38-b9ac-c0dc7e04bdfa tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1676 microversion: 2.1 time: 0.243858 Sep 06 01:16:27.547773 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 376/776] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:27 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1676 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:28.124278 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-dfeac09c-0579-4c47-866f-66f1a42fd86a tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:28.124890 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-dfeac09c-0579-4c47-866f-66f1a42fd86a tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:28.131304 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dfeac09c-0579-4c47-866f-66f1a42fd86a tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:28.131807 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dfeac09c-0579-4c47-866f-66f1a42fd86a tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:28.132247 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dfeac09c-0579-4c47-866f-66f1a42fd86a tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:28.132934 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dfeac09c-0579-4c47-866f-66f1a42fd86a tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:28.133388 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dfeac09c-0579-4c47-866f-66f1a42fd86a tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:28.133812 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dfeac09c-0579-4c47-866f-66f1a42fd86a tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:28.287470 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-dfeac09c-0579-4c47-866f-66f1a42fd86a tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:28.296273 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-dfeac09c-0579-4c47-866f-66f1a42fd86a tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1756 microversion: 2.1 time: 0.175785 Sep 06 01:16:28.296982 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 401/777] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:28 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:28.330863 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-928f9ef9-26f5-49f4-8284-84e2f2ca8cb5 req-c3685232-1083-4ec3-84ed-8e3f57104b2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "366390df-669b-48b1-b741-56d5fdd64441", "tag": "703a4acd-427c-4fd4-bf73-f445a5bcac26"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:16:28.342002 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-928f9ef9-26f5-49f4-8284-84e2f2ca8cb5 req-c3685232-1083-4ec3-84ed-8e3f57104b2e service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:28.342476 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-928f9ef9-26f5-49f4-8284-84e2f2ca8cb5 req-c3685232-1083-4ec3-84ed-8e3f57104b2e service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:28.342899 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-928f9ef9-26f5-49f4-8284-84e2f2ca8cb5 req-c3685232-1083-4ec3-84ed-8e3f57104b2e service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:28.354583 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-928f9ef9-26f5-49f4-8284-84e2f2ca8cb5 req-c3685232-1083-4ec3-84ed-8e3f57104b2e service nova] Creating event network-changed:703a4acd-427c-4fd4-bf73-f445a5bcac26 for instance 366390df-669b-48b1-b741-56d5fdd64441 on hv-cinder-84773 Sep 06 01:16:28.359424 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-928f9ef9-26f5-49f4-8284-84e2f2ca8cb5 req-c3685232-1083-4ec3-84ed-8e3f57104b2e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032255 Sep 06 01:16:28.360069 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 377/778] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:16:28.569717 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-511c9337-b321-4985-a095-538ad3f025f4 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:28.570360 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-511c9337-b321-4985-a095-538ad3f025f4 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:28.576315 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-511c9337-b321-4985-a095-538ad3f025f4 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:28.577076 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-511c9337-b321-4985-a095-538ad3f025f4 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:28.577220 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-511c9337-b321-4985-a095-538ad3f025f4 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:28.577903 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-511c9337-b321-4985-a095-538ad3f025f4 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:28.578353 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-511c9337-b321-4985-a095-538ad3f025f4 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:28.578774 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-511c9337-b321-4985-a095-538ad3f025f4 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:28.718090 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-511c9337-b321-4985-a095-538ad3f025f4 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:28.727836 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-511c9337-b321-4985-a095-538ad3f025f4 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1653 microversion: 2.1 time: 0.161894 Sep 06 01:16:28.735797 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 402/779] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:28 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1653 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:28.750903 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2800dee4-4443-4c42-8668-835d3db078ed tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:16:28.757156 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2800dee4-4443-4c42-8668-835d3db078ed tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:28.757634 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2800dee4-4443-4c42-8668-835d3db078ed tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:28.758070 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2800dee4-4443-4c42-8668-835d3db078ed tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:28.781056 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2800dee4-4443-4c42-8668-835d3db078ed tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Going to try to start instance {{(pid=120581) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 06 01:16:28.825265 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2800dee4-4443-4c42-8668-835d3db078ed tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "POST /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba/action" status: 202 len: 0 microversion: 2.1 time: 0.078344 Sep 06 01:16:28.826029 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 378/780] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Sep 6 01:16:28 2022] POST /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 01:16:28.835504 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-bac4b07f-c64e-4a95-81a0-c1a2753582a0 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:28.836140 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-bac4b07f-c64e-4a95-81a0-c1a2753582a0 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:28.842822 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-bac4b07f-c64e-4a95-81a0-c1a2753582a0 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:28.843508 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-bac4b07f-c64e-4a95-81a0-c1a2753582a0 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:28.844783 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-bac4b07f-c64e-4a95-81a0-c1a2753582a0 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:28.845576 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-bac4b07f-c64e-4a95-81a0-c1a2753582a0 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:28.846114 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-bac4b07f-c64e-4a95-81a0-c1a2753582a0 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:28.846621 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-bac4b07f-c64e-4a95-81a0-c1a2753582a0 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:28.991405 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-bac4b07f-c64e-4a95-81a0-c1a2753582a0 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:28.999131 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-bac4b07f-c64e-4a95-81a0-c1a2753582a0 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1662 microversion: 2.1 time: 0.168488 Sep 06 01:16:28.999701 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 403/781] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:28 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1662 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:16:29.321328 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-36831fa9-aa99-49d8-80c2-41fb8d21d275 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:29.322065 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-36831fa9-aa99-49d8-80c2-41fb8d21d275 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:29.328534 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-36831fa9-aa99-49d8-80c2-41fb8d21d275 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:29.329026 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-36831fa9-aa99-49d8-80c2-41fb8d21d275 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:29.329470 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-36831fa9-aa99-49d8-80c2-41fb8d21d275 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:29.330178 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-36831fa9-aa99-49d8-80c2-41fb8d21d275 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:29.330636 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-36831fa9-aa99-49d8-80c2-41fb8d21d275 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:29.331065 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-36831fa9-aa99-49d8-80c2-41fb8d21d275 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:29.482251 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-36831fa9-aa99-49d8-80c2-41fb8d21d275 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:29.490944 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-36831fa9-aa99-49d8-80c2-41fb8d21d275 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1756 microversion: 2.1 time: 0.173936 Sep 06 01:16:29.491522 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 379/782] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:29 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:30.023067 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-2a50bd45-c14c-4ea3-bfa8-3707e028b2fe tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:30.023679 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-2a50bd45-c14c-4ea3-bfa8-3707e028b2fe tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:30.030094 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2a50bd45-c14c-4ea3-bfa8-3707e028b2fe tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:30.030576 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2a50bd45-c14c-4ea3-bfa8-3707e028b2fe tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:30.031010 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2a50bd45-c14c-4ea3-bfa8-3707e028b2fe tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:30.031693 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2a50bd45-c14c-4ea3-bfa8-3707e028b2fe tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:30.032171 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2a50bd45-c14c-4ea3-bfa8-3707e028b2fe tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:30.032596 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2a50bd45-c14c-4ea3-bfa8-3707e028b2fe tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:30.166342 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-2a50bd45-c14c-4ea3-bfa8-3707e028b2fe tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:30.174128 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-2a50bd45-c14c-4ea3-bfa8-3707e028b2fe tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1662 microversion: 2.1 time: 0.155532 Sep 06 01:16:30.174688 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 404/783] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:30 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1662 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:30.514351 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-19bcdcdf-7418-4879-93d2-8b57e35a6d68 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:30.514965 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-19bcdcdf-7418-4879-93d2-8b57e35a6d68 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:30.521485 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19bcdcdf-7418-4879-93d2-8b57e35a6d68 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:30.521969 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19bcdcdf-7418-4879-93d2-8b57e35a6d68 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:30.522406 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19bcdcdf-7418-4879-93d2-8b57e35a6d68 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:30.523095 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19bcdcdf-7418-4879-93d2-8b57e35a6d68 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:30.523555 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19bcdcdf-7418-4879-93d2-8b57e35a6d68 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:30.524008 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19bcdcdf-7418-4879-93d2-8b57e35a6d68 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:30.670932 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-19bcdcdf-7418-4879-93d2-8b57e35a6d68 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:30.680395 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-19bcdcdf-7418-4879-93d2-8b57e35a6d68 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1756 microversion: 2.1 time: 0.169839 Sep 06 01:16:30.680901 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 380/784] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:30 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:31.197322 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-83ee05dc-fb87-4821-9dac-fc91defb07fd tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:31.197946 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-83ee05dc-fb87-4821-9dac-fc91defb07fd tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:31.204259 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-83ee05dc-fb87-4821-9dac-fc91defb07fd tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:31.204735 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-83ee05dc-fb87-4821-9dac-fc91defb07fd tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:31.205203 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-83ee05dc-fb87-4821-9dac-fc91defb07fd tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:31.205879 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-83ee05dc-fb87-4821-9dac-fc91defb07fd tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:31.206327 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-83ee05dc-fb87-4821-9dac-fc91defb07fd tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:31.207243 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-83ee05dc-fb87-4821-9dac-fc91defb07fd tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:31.334286 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-83ee05dc-fb87-4821-9dac-fc91defb07fd tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:31.341811 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-83ee05dc-fb87-4821-9dac-fc91defb07fd tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1666 microversion: 2.1 time: 0.148368 Sep 06 01:16:31.342364 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 405/785] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:31 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1666 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:31.703875 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-56dc2f4a-b85d-4aea-a538-a12c28d7a383 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:31.704516 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-56dc2f4a-b85d-4aea-a538-a12c28d7a383 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:31.710981 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-56dc2f4a-b85d-4aea-a538-a12c28d7a383 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:31.711461 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-56dc2f4a-b85d-4aea-a538-a12c28d7a383 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:31.711929 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-56dc2f4a-b85d-4aea-a538-a12c28d7a383 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:31.712616 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-56dc2f4a-b85d-4aea-a538-a12c28d7a383 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:31.713068 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-56dc2f4a-b85d-4aea-a538-a12c28d7a383 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:31.713494 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-56dc2f4a-b85d-4aea-a538-a12c28d7a383 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:31.852661 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-56dc2f4a-b85d-4aea-a538-a12c28d7a383 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:31.860702 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-56dc2f4a-b85d-4aea-a538-a12c28d7a383 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1756 microversion: 2.1 time: 0.160749 Sep 06 01:16:31.861263 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 381/786] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:31 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:32.887359 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-8311f259-dbe2-47eb-8519-bd3919feed71 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:32.887921 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-8311f259-dbe2-47eb-8519-bd3919feed71 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:32.896834 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8311f259-dbe2-47eb-8519-bd3919feed71 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:32.897571 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8311f259-dbe2-47eb-8519-bd3919feed71 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:32.898283 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8311f259-dbe2-47eb-8519-bd3919feed71 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:32.899303 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8311f259-dbe2-47eb-8519-bd3919feed71 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:32.899935 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8311f259-dbe2-47eb-8519-bd3919feed71 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:32.900365 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8311f259-dbe2-47eb-8519-bd3919feed71 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:33.038598 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-8311f259-dbe2-47eb-8519-bd3919feed71 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:33.046978 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-8311f259-dbe2-47eb-8519-bd3919feed71 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1756 microversion: 2.1 time: 0.165681 Sep 06 01:16:33.047544 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 406/787] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:32 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:34.070191 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8d4528c5-2fab-4d46-9725-83945aea0544 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:34.070801 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8d4528c5-2fab-4d46-9725-83945aea0544 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:34.077345 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d4528c5-2fab-4d46-9725-83945aea0544 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:34.077823 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d4528c5-2fab-4d46-9725-83945aea0544 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:34.078258 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d4528c5-2fab-4d46-9725-83945aea0544 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:34.078950 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d4528c5-2fab-4d46-9725-83945aea0544 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:34.079400 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d4528c5-2fab-4d46-9725-83945aea0544 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:34.079851 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d4528c5-2fab-4d46-9725-83945aea0544 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:34.432679 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-8d4528c5-2fab-4d46-9725-83945aea0544 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:34.440644 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8d4528c5-2fab-4d46-9725-83945aea0544 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1756 microversion: 2.1 time: 0.374449 Sep 06 01:16:34.441205 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 382/788] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:34 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1756 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:35.464357 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-8dcdc139-3d7c-4f70-b6f6-212de6aa54a4 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:35.464973 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-8dcdc139-3d7c-4f70-b6f6-212de6aa54a4 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:35.471410 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8dcdc139-3d7c-4f70-b6f6-212de6aa54a4 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:35.471925 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8dcdc139-3d7c-4f70-b6f6-212de6aa54a4 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:35.472364 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8dcdc139-3d7c-4f70-b6f6-212de6aa54a4 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:35.473051 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8dcdc139-3d7c-4f70-b6f6-212de6aa54a4 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:35.473504 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8dcdc139-3d7c-4f70-b6f6-212de6aa54a4 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:35.473929 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8dcdc139-3d7c-4f70-b6f6-212de6aa54a4 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:35.613186 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-8dcdc139-3d7c-4f70-b6f6-212de6aa54a4 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:35.621235 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-8dcdc139-3d7c-4f70-b6f6-212de6aa54a4 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1756 microversion: 2.1 time: 0.160721 Sep 06 01:16:35.621793 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 407/789] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:35 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:36.644888 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2ef83dbf-ea39-40d9-be8c-fec3bd1e5d95 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:36.645496 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2ef83dbf-ea39-40d9-be8c-fec3bd1e5d95 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:36.651957 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2ef83dbf-ea39-40d9-be8c-fec3bd1e5d95 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:36.652434 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2ef83dbf-ea39-40d9-be8c-fec3bd1e5d95 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:36.652864 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2ef83dbf-ea39-40d9-be8c-fec3bd1e5d95 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:36.653573 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2ef83dbf-ea39-40d9-be8c-fec3bd1e5d95 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:36.654021 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2ef83dbf-ea39-40d9-be8c-fec3bd1e5d95 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:36.654444 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2ef83dbf-ea39-40d9-be8c-fec3bd1e5d95 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:36.795204 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-2ef83dbf-ea39-40d9-be8c-fec3bd1e5d95 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:36.803650 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2ef83dbf-ea39-40d9-be8c-fec3bd1e5d95 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1756 microversion: 2.1 time: 0.163184 Sep 06 01:16:36.804230 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 383/790] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:36 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:37.155665 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-f845eb22-9bfc-479e-bd54-39a1c95fc09e tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:37.156194 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-f845eb22-9bfc-479e-bd54-39a1c95fc09e tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: a23ae8e0-f66b-46e1-a6fe-ac890b3efe45] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:37.162124 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f845eb22-9bfc-479e-bd54-39a1c95fc09e tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:37.162606 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f845eb22-9bfc-479e-bd54-39a1c95fc09e tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:37.163045 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f845eb22-9bfc-479e-bd54-39a1c95fc09e tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:37.163820 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f845eb22-9bfc-479e-bd54-39a1c95fc09e tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:37.164287 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f845eb22-9bfc-479e-bd54-39a1c95fc09e tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:37.164713 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f845eb22-9bfc-479e-bd54-39a1c95fc09e tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:37.197454 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-f845eb22-9bfc-479e-bd54-39a1c95fc09e tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45/ips" status: 200 len: 150 microversion: 2.1 time: 0.144828 Sep 06 01:16:37.198015 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 408/791] 10.222.0.23 () {58 vars in 1248 bytes} [Tue Sep 6 01:16:37 2022] GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45/ips => generated 150 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:16:37.827368 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4108f068-ee85-4fb0-82e9-7cd739c55e13 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:37.828016 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4108f068-ee85-4fb0-82e9-7cd739c55e13 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:37.835025 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4108f068-ee85-4fb0-82e9-7cd739c55e13 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:37.835514 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4108f068-ee85-4fb0-82e9-7cd739c55e13 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:37.835993 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4108f068-ee85-4fb0-82e9-7cd739c55e13 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:37.836687 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4108f068-ee85-4fb0-82e9-7cd739c55e13 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:37.837146 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4108f068-ee85-4fb0-82e9-7cd739c55e13 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:37.837574 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4108f068-ee85-4fb0-82e9-7cd739c55e13 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:37.856001 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:16:37.978987 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-4108f068-ee85-4fb0-82e9-7cd739c55e13 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:37.987246 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4108f068-ee85-4fb0-82e9-7cd739c55e13 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1756 microversion: 2.1 time: 0.163860 Sep 06 01:16:37.987829 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 384/792] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:37 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:38.526405 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-6fc9ad82-4cf1-436e-8b66-8a9140532a23 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a96e2a41-22c9-423e-9d86-ef6548e847c2"}} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:16:38.528712 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-6fc9ad82-4cf1-436e-8b66-8a9140532a23 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: a23ae8e0-f66b-46e1-a6fe-ac890b3efe45] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:38.535229 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6fc9ad82-4cf1-436e-8b66-8a9140532a23 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:38.535715 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6fc9ad82-4cf1-436e-8b66-8a9140532a23 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:38.536186 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6fc9ad82-4cf1-436e-8b66-8a9140532a23 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:38.537206 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6fc9ad82-4cf1-436e-8b66-8a9140532a23 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:38.537944 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6fc9ad82-4cf1-436e-8b66-8a9140532a23 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:38.538656 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6fc9ad82-4cf1-436e-8b66-8a9140532a23 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:38.784687 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-6fc9ad82-4cf1-436e-8b66-8a9140532a23 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "POST /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262300 Sep 06 01:16:38.785292 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 409/793] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Sep 6 01:16:38 2022] POST /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:16:39.010164 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7f75ef6c-2f5f-48e0-90fb-cb56e86e096d tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:39.010783 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7f75ef6c-2f5f-48e0-90fb-cb56e86e096d tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:39.017121 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f75ef6c-2f5f-48e0-90fb-cb56e86e096d tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:39.017601 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f75ef6c-2f5f-48e0-90fb-cb56e86e096d tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:39.018035 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f75ef6c-2f5f-48e0-90fb-cb56e86e096d tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:39.019353 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f75ef6c-2f5f-48e0-90fb-cb56e86e096d tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:39.019913 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f75ef6c-2f5f-48e0-90fb-cb56e86e096d tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:39.020339 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f75ef6c-2f5f-48e0-90fb-cb56e86e096d tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:39.161107 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-7f75ef6c-2f5f-48e0-90fb-cb56e86e096d tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:39.169761 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7f75ef6c-2f5f-48e0-90fb-cb56e86e096d tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1759 microversion: 2.1 time: 0.163495 Sep 06 01:16:39.170347 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 385/794] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:39 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1759 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:46.317745 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-f6b83088-ea25-4f07-b1a7-dfabd53020c4 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a96e2a41-22c9-423e-9d86-ef6548e847c2"}} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:16:46.320126 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-f6b83088-ea25-4f07-b1a7-dfabd53020c4 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: a23ae8e0-f66b-46e1-a6fe-ac890b3efe45] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:46.323064 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_api:SELECT=78 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:16:46.328399 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f6b83088-ea25-4f07-b1a7-dfabd53020c4 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:46.328872 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f6b83088-ea25-4f07-b1a7-dfabd53020c4 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:46.329303 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f6b83088-ea25-4f07-b1a7-dfabd53020c4 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:46.329982 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f6b83088-ea25-4f07-b1a7-dfabd53020c4 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:46.330446 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f6b83088-ea25-4f07-b1a7-dfabd53020c4 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:46.330854 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f6b83088-ea25-4f07-b1a7-dfabd53020c4 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:46.407969 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.wsgi [None req-f6b83088-ea25-4f07-b1a7-dfabd53020c4 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] HTTP exception thrown: Invalid volume: volume a96e2a41-22c9-423e-9d86-ef6548e847c2 is already attached to instances: a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 Sep 06 01:16:46.409995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-f6b83088-ea25-4f07-b1a7-dfabd53020c4 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Request method failure captured: Sep 06 01:16:46.409995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: request: POST /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45/os-volume_attachments HTTP/1.1 Sep 06 01:16:46.409995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept: application/json Sep 06 01:16:46.409995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept-Encoding: identity Sep 06 01:16:46.409995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Connection: close Sep 06 01:16:46.409995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Length: 74 Sep 06 01:16:46.409995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Type: application/json Sep 06 01:16:46.409995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Host: 10.222.0.23 Sep 06 01:16:46.409995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Openstack-System-Scope: None Sep 06 01:16:46.409995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: User-Agent: python-urllib3/1.26.12 Sep 06 01:16:46.409995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Auth-Token: gAAAAABjFp5HgEJZI7pOCAbhWXwWFE8yQ5t7K_Ws-jshDHbF7sXnYLPl16IIONgrpvYxWiZSDSAeitprugb5h17_eYSiBNUfLgmC9hbcnAOoP7NTvslLSb0CTURVLZpiFrwKL1VvcCbnqL_bQbP7LRSB17fvFEoXQ1dcjQQQPX7LNrOn0pG4F5A Sep 06 01:16:46.409995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Id: None Sep 06 01:16:46.409995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Name: None Sep 06 01:16:46.409995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Identity-Status: Confirmed Sep 06 01:16:46.409995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Is-Admin-Project: True Sep 06 01:16:46.409995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Id: default Sep 06 01:16:46.409995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Name: Default Sep 06 01:16:46.409995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Id: 1fa73b0bfee14a9ea25f03e523078995 Sep 06 01:16:46.409995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Name: tempest-AttachVolumeNegativeTest-1412452604 Sep 06 01:16:46.409995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Role: reader,member Sep 06 01:16:46.409995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Roles: reader,member Sep 06 01:16:46.411702 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1fa73b0bfee14a9ea25f03e523078995"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1fa73b0bfee14a9ea25f03e523078995"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1fa73b0bfee14a9ea25f03e523078995"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1fa73b0bfee14a9ea25f03e523078995"}]}] Sep 06 01:16:46.411702 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant: tempest-AttachVolumeNegativeTest-1412452604 Sep 06 01:16:46.411702 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Id: 1fa73b0bfee14a9ea25f03e523078995 Sep 06 01:16:46.411702 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1412452604 Sep 06 01:16:46.411702 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User: tempest-AttachVolumeNegativeTest-1412452604-project Sep 06 01:16:46.411702 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Id: default Sep 06 01:16:46.411702 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Name: Default Sep 06 01:16:46.411702 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Id: f8f44df824414e5ebc8cfd2126e9d66f Sep 06 01:16:46.411702 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Name: tempest-AttachVolumeNegativeTest-1412452604-project Sep 06 01:16:46.411702 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Sep 06 01:16:46.411702 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: {"volumeAttachment": {"volumeId": "a96e2a41-22c9-423e-9d86-ef6548e847c2"}} Sep 06 01:16:46.411702 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: method: > Sep 06 01:16:46.412513 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: exception: Invalid volume: volume a96e2a41-22c9-423e-9d86-ef6548e847c2 is already attached to instances: a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 Sep 06 01:16:46.412513 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: action_args: {'server_id': 'a23ae8e0-f66b-46e1-a6fe-ac890b3efe45', 'body': {'volumeAttachment': {'volumeId': 'a96e2a41-22c9-423e-9d86-ef6548e847c2'}}} Sep 06 01:16:46.412513 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:16:46.412513 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:16:46.412513 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 06 01:16:46.412513 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 06 01:16:46.412513 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 01:16:46.412513 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 01:16:46.412513 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 06 01:16:46.412513 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 06 01:16:46.412513 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 06 01:16:46.412513 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 06 01:16:46.412513 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 06 01:16:46.412513 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 06 01:16:46.412513 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a96e2a41-22c9-423e-9d86-ef6548e847c2 is already attached to instances: a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 Sep 06 01:16:46.412513 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:16:46.412513 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:16:46.412513 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:16:46.412513 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:16:46.413961 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:16:46.413961 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:16:46.413961 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:16:46.413961 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:16:46.413961 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:16:46.413961 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:16:46.413961 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 01:16:46.413961 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 01:16:46.413961 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 01:16:46.413961 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 01:16:46.413961 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 01:16:46.413961 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 01:16:46.413961 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 06 01:16:46.413961 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 06 01:16:46.413961 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a96e2a41-22c9-423e-9d86-ef6548e847c2 is already attached to instances: a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 Sep 06 01:16:46.413961 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:16:46.413961 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:16:46.413961 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:16:46.413961 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:16:46.413961 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:16:46.415455 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:16:46.415455 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:16:46.415455 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:16:46.415455 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a96e2a41-22c9-423e-9d86-ef6548e847c2 is already attached to instances: a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 Sep 06 01:16:46.415455 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:16:46.415455 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-f6b83088-ea25-4f07-b1a7-dfabd53020c4 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Returning 400 to user: Invalid volume: volume a96e2a41-22c9-423e-9d86-ef6548e847c2 is already attached to instances: a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 {{(pid=120580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:16:46.415455 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-f6b83088-ea25-4f07-b1a7-dfabd53020c4 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "POST /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098575 Sep 06 01:16:46.415455 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 410/795] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Sep 6 01:16:46 2022] POST /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 01:16:46.477378 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-934ef0df-4dfe-4973-b2d0-7269000194f9 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:46.477863 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-934ef0df-4dfe-4973-b2d0-7269000194f9 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: a23ae8e0-f66b-46e1-a6fe-ac890b3efe45] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:46.484588 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-934ef0df-4dfe-4973-b2d0-7269000194f9 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:46.485072 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-934ef0df-4dfe-4973-b2d0-7269000194f9 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:46.485507 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-934ef0df-4dfe-4973-b2d0-7269000194f9 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:46.486197 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-934ef0df-4dfe-4973-b2d0-7269000194f9 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:46.486653 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-934ef0df-4dfe-4973-b2d0-7269000194f9 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:46.487098 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-934ef0df-4dfe-4973-b2d0-7269000194f9 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:46.568595 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-934ef0df-4dfe-4973-b2d0-7269000194f9 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lazy-loading 'services' on Instance uuid a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 01:16:46.640945 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-934ef0df-4dfe-4973-b2d0-7269000194f9 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45/os-volume_attachments/a96e2a41-22c9-423e-9d86-ef6548e847c2" status: 202 len: 0 microversion: 2.1 time: 0.167400 Sep 06 01:16:46.641708 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 386/796] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Sep 6 01:16:46 2022] DELETE /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45/os-volume_attachments/a96e2a41-22c9-423e-9d86-ef6548e847c2 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 01:16:46.649975 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-45785c8e-04e8-4dc3-8104-6fc50c44a3ba tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:46.652233 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-45785c8e-04e8-4dc3-8104-6fc50c44a3ba tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: a23ae8e0-f66b-46e1-a6fe-ac890b3efe45] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:46.659371 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-45785c8e-04e8-4dc3-8104-6fc50c44a3ba tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:46.659890 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-45785c8e-04e8-4dc3-8104-6fc50c44a3ba tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:46.660324 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-45785c8e-04e8-4dc3-8104-6fc50c44a3ba tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:46.661012 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-45785c8e-04e8-4dc3-8104-6fc50c44a3ba tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:46.661459 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-45785c8e-04e8-4dc3-8104-6fc50c44a3ba tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:46.661880 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-45785c8e-04e8-4dc3-8104-6fc50c44a3ba tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:46.694827 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-45785c8e-04e8-4dc3-8104-6fc50c44a3ba tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048653 Sep 06 01:16:46.695384 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 411/797] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 6 01:16:46 2022] GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:16:47.708871 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a1181bc4-1373-4c2a-9b7e-06e9983cf22d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:47.711235 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a1181bc4-1373-4c2a-9b7e-06e9983cf22d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: a23ae8e0-f66b-46e1-a6fe-ac890b3efe45] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:47.717363 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a1181bc4-1373-4c2a-9b7e-06e9983cf22d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:47.717842 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a1181bc4-1373-4c2a-9b7e-06e9983cf22d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:47.718273 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a1181bc4-1373-4c2a-9b7e-06e9983cf22d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:47.718947 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a1181bc4-1373-4c2a-9b7e-06e9983cf22d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:47.719392 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a1181bc4-1373-4c2a-9b7e-06e9983cf22d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:47.719833 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a1181bc4-1373-4c2a-9b7e-06e9983cf22d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:47.747743 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a1181bc4-1373-4c2a-9b7e-06e9983cf22d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044270 Sep 06 01:16:47.748307 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 387/798] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 6 01:16:47 2022] GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 01:16:47.810817 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-a051635b-ebbe-4bb1-bdb4-7a47926c72b6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:47.811629 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-a051635b-ebbe-4bb1-bdb4-7a47926c72b6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: a23ae8e0-f66b-46e1-a6fe-ac890b3efe45] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:47.819568 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a051635b-ebbe-4bb1-bdb4-7a47926c72b6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:47.820100 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a051635b-ebbe-4bb1-bdb4-7a47926c72b6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:47.820551 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a051635b-ebbe-4bb1-bdb4-7a47926c72b6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:47.821323 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a051635b-ebbe-4bb1-bdb4-7a47926c72b6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:47.822083 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a051635b-ebbe-4bb1-bdb4-7a47926c72b6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:47.822539 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a051635b-ebbe-4bb1-bdb4-7a47926c72b6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:47.847631 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-a051635b-ebbe-4bb1-bdb4-7a47926c72b6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: a23ae8e0-f66b-46e1-a6fe-ac890b3efe45] Going to try to terminate instance {{(pid=120580) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 01:16:47.850268 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:16:47.921377 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-a051635b-ebbe-4bb1-bdb4-7a47926c72b6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45" status: 204 len: 0 microversion: 2.1 time: 0.114846 Sep 06 01:16:47.921944 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 412/799] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 6 01:16:47 2022] DELETE /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 01:16:47.930897 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b05f4112-dfe0-4a1b-8b92-b6ff61f242e3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:47.931508 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b05f4112-dfe0-4a1b-8b92-b6ff61f242e3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: a23ae8e0-f66b-46e1-a6fe-ac890b3efe45] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:47.937645 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b05f4112-dfe0-4a1b-8b92-b6ff61f242e3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:47.938293 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b05f4112-dfe0-4a1b-8b92-b6ff61f242e3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:47.938749 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b05f4112-dfe0-4a1b-8b92-b6ff61f242e3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:47.939505 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b05f4112-dfe0-4a1b-8b92-b6ff61f242e3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:47.939986 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b05f4112-dfe0-4a1b-8b92-b6ff61f242e3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:47.940435 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b05f4112-dfe0-4a1b-8b92-b6ff61f242e3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:48.071973 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-b05f4112-dfe0-4a1b-8b92-b6ff61f242e3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:48.079560 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b05f4112-dfe0-4a1b-8b92-b6ff61f242e3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45" status: 200 len: 1681 microversion: 2.1 time: 0.152692 Sep 06 01:16:48.080136 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 388/800] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:47 2022] GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:49.104982 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-35a9f69c-1b85-4938-a667-a1b8289fc570 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:49.105708 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-35a9f69c-1b85-4938-a667-a1b8289fc570 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: a23ae8e0-f66b-46e1-a6fe-ac890b3efe45] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:49.112218 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-35a9f69c-1b85-4938-a667-a1b8289fc570 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:49.112696 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-35a9f69c-1b85-4938-a667-a1b8289fc570 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:49.113128 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-35a9f69c-1b85-4938-a667-a1b8289fc570 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:49.113811 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-35a9f69c-1b85-4938-a667-a1b8289fc570 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:49.114262 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-35a9f69c-1b85-4938-a667-a1b8289fc570 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:49.114681 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-35a9f69c-1b85-4938-a667-a1b8289fc570 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:49.241386 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-35a9f69c-1b85-4938-a667-a1b8289fc570 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:49.249032 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-35a9f69c-1b85-4938-a667-a1b8289fc570 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45" status: 200 len: 1681 microversion: 2.1 time: 0.148641 Sep 06 01:16:49.249597 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 413/801] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:49 2022] GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:16:50.271627 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ae151171-59ff-4b8b-9f5b-bb008b0191f7 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:50.272273 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ae151171-59ff-4b8b-9f5b-bb008b0191f7 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: a23ae8e0-f66b-46e1-a6fe-ac890b3efe45] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:50.278773 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ae151171-59ff-4b8b-9f5b-bb008b0191f7 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:50.279246 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ae151171-59ff-4b8b-9f5b-bb008b0191f7 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:50.279673 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ae151171-59ff-4b8b-9f5b-bb008b0191f7 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:50.280376 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ae151171-59ff-4b8b-9f5b-bb008b0191f7 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:50.280826 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ae151171-59ff-4b8b-9f5b-bb008b0191f7 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:50.281240 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ae151171-59ff-4b8b-9f5b-bb008b0191f7 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:50.419619 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-ae151171-59ff-4b8b-9f5b-bb008b0191f7 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:50.429854 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ae151171-59ff-4b8b-9f5b-bb008b0191f7 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45" status: 200 len: 1681 microversion: 2.1 time: 0.161906 Sep 06 01:16:50.431016 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 389/802] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:50 2022] GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:50.677777 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-6e96f500-8922-481a-beba-0c6661993ee2 req-042c5924-ee77-43a2-bf14-65e72c13ebe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a23ae8e0-f66b-46e1-a6fe-ac890b3efe45", "name": "network-vif-deleted", "tag": "90ca3270-3768-4e11-aa21-10a962ec5f79"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:16:50.687973 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-6e96f500-8922-481a-beba-0c6661993ee2 req-042c5924-ee77-43a2-bf14-65e72c13ebe3 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:50.688469 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-6e96f500-8922-481a-beba-0c6661993ee2 req-042c5924-ee77-43a2-bf14-65e72c13ebe3 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:50.688881 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-6e96f500-8922-481a-beba-0c6661993ee2 req-042c5924-ee77-43a2-bf14-65e72c13ebe3 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:50.700877 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.compute.server_external_events [req-6e96f500-8922-481a-beba-0c6661993ee2 req-042c5924-ee77-43a2-bf14-65e72c13ebe3 service nova] Creating event network-vif-deleted:90ca3270-3768-4e11-aa21-10a962ec5f79 for instance a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 on hv-cinder-84773 Sep 06 01:16:50.706253 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [req-6e96f500-8922-481a-beba-0c6661993ee2 req-042c5924-ee77-43a2-bf14-65e72c13ebe3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032525 Sep 06 01:16:50.706851 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 414/803] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:16:51.454663 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-25c4e6e9-cfe2-4f80-b869-0453c0bd3abd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:51.455292 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-25c4e6e9-cfe2-4f80-b869-0453c0bd3abd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: a23ae8e0-f66b-46e1-a6fe-ac890b3efe45] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:51.458986 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=48 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:16:51.463877 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25c4e6e9-cfe2-4f80-b869-0453c0bd3abd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:51.464651 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25c4e6e9-cfe2-4f80-b869-0453c0bd3abd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:51.465086 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25c4e6e9-cfe2-4f80-b869-0453c0bd3abd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:51.465782 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25c4e6e9-cfe2-4f80-b869-0453c0bd3abd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:51.466234 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25c4e6e9-cfe2-4f80-b869-0453c0bd3abd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:51.466649 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25c4e6e9-cfe2-4f80-b869-0453c0bd3abd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:51.506928 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25c4e6e9-cfe2-4f80-b869-0453c0bd3abd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:51.507436 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25c4e6e9-cfe2-4f80-b869-0453c0bd3abd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:51.507865 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25c4e6e9-cfe2-4f80-b869-0453c0bd3abd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:51.508379 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-25c4e6e9-cfe2-4f80-b869-0453c0bd3abd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lazy-loading 'fault' on Instance uuid a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 01:16:51.551441 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-25c4e6e9-cfe2-4f80-b869-0453c0bd3abd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:51.558988 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-25c4e6e9-cfe2-4f80-b869-0453c0bd3abd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45" status: 200 len: 1331 microversion: 2.1 time: 0.109352 Sep 06 01:16:51.559558 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 390/804] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:51 2022] GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 => generated 1331 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:52.583230 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-6d016def-c25b-49cd-b2b4-41f29b16eb11 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:52.584482 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-6d016def-c25b-49cd-b2b4-41f29b16eb11 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: a23ae8e0-f66b-46e1-a6fe-ac890b3efe45] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:52.590532 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6d016def-c25b-49cd-b2b4-41f29b16eb11 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:52.591003 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6d016def-c25b-49cd-b2b4-41f29b16eb11 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:52.591436 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6d016def-c25b-49cd-b2b4-41f29b16eb11 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:52.592154 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6d016def-c25b-49cd-b2b4-41f29b16eb11 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:52.592604 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6d016def-c25b-49cd-b2b4-41f29b16eb11 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:52.593021 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6d016def-c25b-49cd-b2b4-41f29b16eb11 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:52.605834 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.wsgi [None req-6d016def-c25b-49cd-b2b4-41f29b16eb11 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] HTTP exception thrown: Instance a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 could not be found. Sep 06 01:16:52.607410 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-6d016def-c25b-49cd-b2b4-41f29b16eb11 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Request method failure captured: Sep 06 01:16:52.607410 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: request: GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 HTTP/1.1 Sep 06 01:16:52.607410 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept: application/json Sep 06 01:16:52.607410 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept-Encoding: identity Sep 06 01:16:52.607410 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Connection: close Sep 06 01:16:52.607410 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Length: 0 Sep 06 01:16:52.607410 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Type: application/json Sep 06 01:16:52.607410 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Host: 10.222.0.23 Sep 06 01:16:52.607410 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Openstack-System-Scope: None Sep 06 01:16:52.607410 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: User-Agent: python-urllib3/1.26.12 Sep 06 01:16:52.607410 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Auth-Token: gAAAAABjFp5HgEJZI7pOCAbhWXwWFE8yQ5t7K_Ws-jshDHbF7sXnYLPl16IIONgrpvYxWiZSDSAeitprugb5h17_eYSiBNUfLgmC9hbcnAOoP7NTvslLSb0CTURVLZpiFrwKL1VvcCbnqL_bQbP7LRSB17fvFEoXQ1dcjQQQPX7LNrOn0pG4F5A Sep 06 01:16:52.607410 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Id: None Sep 06 01:16:52.607410 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Name: None Sep 06 01:16:52.607410 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Identity-Status: Confirmed Sep 06 01:16:52.607410 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Is-Admin-Project: True Sep 06 01:16:52.607410 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Id: default Sep 06 01:16:52.607410 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Name: Default Sep 06 01:16:52.607410 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Id: 1fa73b0bfee14a9ea25f03e523078995 Sep 06 01:16:52.607410 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Name: tempest-AttachVolumeNegativeTest-1412452604 Sep 06 01:16:52.607410 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Role: reader,member Sep 06 01:16:52.607410 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Roles: reader,member Sep 06 01:16:52.609014 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1fa73b0bfee14a9ea25f03e523078995"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1fa73b0bfee14a9ea25f03e523078995"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1fa73b0bfee14a9ea25f03e523078995"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1fa73b0bfee14a9ea25f03e523078995"}]}] Sep 06 01:16:52.609014 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant: tempest-AttachVolumeNegativeTest-1412452604 Sep 06 01:16:52.609014 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Id: 1fa73b0bfee14a9ea25f03e523078995 Sep 06 01:16:52.609014 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1412452604 Sep 06 01:16:52.609014 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User: tempest-AttachVolumeNegativeTest-1412452604-project Sep 06 01:16:52.609014 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Id: default Sep 06 01:16:52.609014 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Name: Default Sep 06 01:16:52.609014 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Id: f8f44df824414e5ebc8cfd2126e9d66f Sep 06 01:16:52.609014 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Name: tempest-AttachVolumeNegativeTest-1412452604-project Sep 06 01:16:52.609014 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: method: > Sep 06 01:16:52.609014 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: exception: Instance a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 could not be found. Sep 06 01:16:52.609014 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: action_args: {'id': 'a23ae8e0-f66b-46e1-a6fe-ac890b3efe45'} Sep 06 01:16:52.609876 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:16:52.609876 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:16:52.609876 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 01:16:52.609876 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 01:16:52.609876 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 01:16:52.609876 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 01:16:52.609876 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 01:16:52.609876 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 01:16:52.609876 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 01:16:52.609876 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 01:16:52.609876 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 could not be found. Sep 06 01:16:52.609876 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:16:52.609876 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:16:52.609876 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:16:52.609876 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:16:52.609876 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:16:52.609876 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:16:52.609876 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:16:52.609876 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:16:52.609876 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:16:52.611299 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:16:52.611299 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 01:16:52.611299 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 01:16:52.611299 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 01:16:52.611299 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 01:16:52.611299 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 01:16:52.611299 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:16:52.611299 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 could not be found. Sep 06 01:16:52.611299 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:16:52.611299 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:16:52.611299 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:16:52.611299 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:16:52.611299 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:16:52.611299 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:16:52.611299 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:16:52.611299 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:16:52.611299 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 could not be found. Sep 06 01:16:52.611299 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:16:52.612626 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-6d016def-c25b-49cd-b2b4-41f29b16eb11 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Returning 404 to user: Instance a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 could not be found. {{(pid=120580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:16:52.612626 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-6d016def-c25b-49cd-b2b4-41f29b16eb11 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45" status: 404 len: 111 microversion: 2.1 time: 0.030271 Sep 06 01:16:52.612626 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 415/805] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:52 2022] GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 01:16:52.618266 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b9bdcaa2-3646-4e69-804a-0e29e199fc0a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '.version_select at 0x7fb06df19550>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:52.637465 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b9bdcaa2-3646-4e69-804a-0e29e199fc0a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-540973257" status: 202 len: 0 microversion: 2.1 time: 0.023459 Sep 06 01:16:52.638025 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 391/806] 10.222.0.23 () {58 vars in 1218 bytes} [Tue Sep 6 01:16:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-540973257 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 01:16:53.229031 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-9324fa55-c3ed-4f55-aa73-9e8d36408a7f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Action: 'create', calling method: .version_select at 0x7fb06df210d0>, body: {"keypair": {"name": "tempest-keypair-468002266", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsZGMUwW3u9nNkVQ3Xl8AdHxWsWak5LIqzkTLZ8b3W5RiwcsYMk4ip5NKVoqaVCNK5ELh4WtPU3uEYkoZctWEHI80a0p/4EXtVKnRTJJTl+Qhc6KZuNVhBDu2QSmOwWwA=="}} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:16:53.243878 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.quota [None req-9324fa55-c3ed-4f55-aa73-9e8d36408a7f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Getting quotas for project 1fa73b0bfee14a9ea25f03e523078995. Resources: {'key_pairs'} {{(pid=120580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 01:16:53.247542 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.quota [None req-9324fa55-c3ed-4f55-aa73-9e8d36408a7f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Getting quotas for user f8f44df824414e5ebc8cfd2126e9d66f and project 1fa73b0bfee14a9ea25f03e523078995. Resources: {'key_pairs'} {{(pid=120580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 01:16:53.268645 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-9324fa55-c3ed-4f55-aa73-9e8d36408a7f tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.043417 Sep 06 01:16:53.269204 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 416/807] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Sep 6 01:16:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:16:54.468919 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-53055c49-1f42-4353-85da-2ed99df8d106 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1549987907", "imageRef": "768973cc-7b5f-4eed-b493-e40eb0de9f88", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d10b81f4-8ccb-48ae-aa86-1440cea903cc"}], "security_groups": [{"name": "tempest-securitygroup--1553176156"}], "key_name": "tempest-keypair-468002266", "user_data": "}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:16:54.568389 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-53055c49-1f42-4353-85da-2ed99df8d106 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] validate_networks() for [('d10b81f4-8ccb-48ae-aa86-1440cea903cc', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 01:16:54.974105 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-53055c49-1f42-4353-85da-2ed99df8d106 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 01:16:54.974557 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-53055c49-1f42-4353-85da-2ed99df8d106 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 01:16:54.975033 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-53055c49-1f42-4353-85da-2ed99df8d106 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 01:16:54.975439 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-53055c49-1f42-4353-85da-2ed99df8d106 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 01:16:54.975876 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-53055c49-1f42-4353-85da-2ed99df8d106 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 01:16:54.984466 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-53055c49-1f42-4353-85da-2ed99df8d106 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:54.984967 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-53055c49-1f42-4353-85da-2ed99df8d106 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:54.985397 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-53055c49-1f42-4353-85da-2ed99df8d106 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:54.986109 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-53055c49-1f42-4353-85da-2ed99df8d106 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:54.986555 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-53055c49-1f42-4353-85da-2ed99df8d106 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:54.986972 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-53055c49-1f42-4353-85da-2ed99df8d106 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:55.003602 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.quota [None req-53055c49-1f42-4353-85da-2ed99df8d106 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Getting quotas for project 1fa73b0bfee14a9ea25f03e523078995. Resources: {'instances', 'ram', 'cores'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 01:16:55.008386 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.quota [None req-53055c49-1f42-4353-85da-2ed99df8d106 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Getting quotas for user f8f44df824414e5ebc8cfd2126e9d66f and project 1fa73b0bfee14a9ea25f03e523078995. Resources: {'instances', 'ram', 'cores'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 01:16:55.018933 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-53055c49-1f42-4353-85da-2ed99df8d106 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 01:16:55.021199 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-53055c49-1f42-4353-85da-2ed99df8d106 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: 35b05aea-d090-4dfc-ac48-250f71e9da06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='768973cc-7b5f-4eed-b493-e40eb0de9f88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 01:16:55.067412 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-53055c49-1f42-4353-85da-2ed99df8d106 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.603262 Sep 06 01:16:55.068145 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 392/808] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Sep 6 01:16:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 01:16:55.080139 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-02183b49-5a12-44ea-a8b4-306eb72cf304 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:55.080750 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-02183b49-5a12-44ea-a8b4-306eb72cf304 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: 35b05aea-d090-4dfc-ac48-250f71e9da06] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:55.136825 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-02183b49-5a12-44ea-a8b4-306eb72cf304 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:55.143687 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-02183b49-5a12-44ea-a8b4-306eb72cf304 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06" status: 200 len: 1241 microversion: 2.1 time: 0.067824 Sep 06 01:16:55.144286 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 417/809] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:55 2022] GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:56.169458 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dbddd371-efc5-4379-929c-d2ea93c38515 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:56.169999 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-dbddd371-efc5-4379-929c-d2ea93c38515 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: 35b05aea-d090-4dfc-ac48-250f71e9da06] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:56.176038 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dbddd371-efc5-4379-929c-d2ea93c38515 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:56.176516 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dbddd371-efc5-4379-929c-d2ea93c38515 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:56.177552 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dbddd371-efc5-4379-929c-d2ea93c38515 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:56.178237 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dbddd371-efc5-4379-929c-d2ea93c38515 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:56.178683 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dbddd371-efc5-4379-929c-d2ea93c38515 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:56.179100 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dbddd371-efc5-4379-929c-d2ea93c38515 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:56.242993 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-dbddd371-efc5-4379-929c-d2ea93c38515 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:56.250418 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dbddd371-efc5-4379-929c-d2ea93c38515 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06" status: 200 len: 1293 microversion: 2.1 time: 0.087276 Sep 06 01:16:56.250965 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 393/810] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:56 2022] GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06 => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:16:57.276166 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-1c090472-987f-4fbd-8e33-26b916ead4f9 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:57.276773 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-1c090472-987f-4fbd-8e33-26b916ead4f9 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: 35b05aea-d090-4dfc-ac48-250f71e9da06] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:57.283015 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1c090472-987f-4fbd-8e33-26b916ead4f9 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:57.283490 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1c090472-987f-4fbd-8e33-26b916ead4f9 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:57.283960 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1c090472-987f-4fbd-8e33-26b916ead4f9 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:57.284644 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1c090472-987f-4fbd-8e33-26b916ead4f9 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:57.285089 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1c090472-987f-4fbd-8e33-26b916ead4f9 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:57.285510 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1c090472-987f-4fbd-8e33-26b916ead4f9 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:57.418666 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-1c090472-987f-4fbd-8e33-26b916ead4f9 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:57.426511 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-1c090472-987f-4fbd-8e33-26b916ead4f9 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06" status: 200 len: 1367 microversion: 2.1 time: 0.154357 Sep 06 01:16:57.427653 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 418/811] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:57 2022] GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:57.835125 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-1921f88c-006e-4b27-a1df-a07679d904e0 req-816a85b3-4d39-4cbc-bba1-945246174cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35b05aea-d090-4dfc-ac48-250f71e9da06", "tag": "5a34555a-ae18-454c-8599-cc82f05f0e3c"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:16:57.845487 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-1921f88c-006e-4b27-a1df-a07679d904e0 req-816a85b3-4d39-4cbc-bba1-945246174cc3 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:57.846517 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-1921f88c-006e-4b27-a1df-a07679d904e0 req-816a85b3-4d39-4cbc-bba1-945246174cc3 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:57.846949 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-1921f88c-006e-4b27-a1df-a07679d904e0 req-816a85b3-4d39-4cbc-bba1-945246174cc3 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:57.858686 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-1921f88c-006e-4b27-a1df-a07679d904e0 req-816a85b3-4d39-4cbc-bba1-945246174cc3 service nova] Creating event network-changed:5a34555a-ae18-454c-8599-cc82f05f0e3c for instance 35b05aea-d090-4dfc-ac48-250f71e9da06 on hv-cinder-84773 Sep 06 01:16:57.863623 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-1921f88c-006e-4b27-a1df-a07679d904e0 req-816a85b3-4d39-4cbc-bba1-945246174cc3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033076 Sep 06 01:16:57.864783 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 394/812] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:16:58.450400 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-9f126ba7-f24f-4484-810d-388f8b5c3742 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:58.451020 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-9f126ba7-f24f-4484-810d-388f8b5c3742 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: 35b05aea-d090-4dfc-ac48-250f71e9da06] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:58.457477 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9f126ba7-f24f-4484-810d-388f8b5c3742 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:58.457953 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9f126ba7-f24f-4484-810d-388f8b5c3742 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:58.458388 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9f126ba7-f24f-4484-810d-388f8b5c3742 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:58.459713 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9f126ba7-f24f-4484-810d-388f8b5c3742 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:58.460224 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9f126ba7-f24f-4484-810d-388f8b5c3742 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:58.460652 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9f126ba7-f24f-4484-810d-388f8b5c3742 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:58.586349 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-9f126ba7-f24f-4484-810d-388f8b5c3742 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:58.594083 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-9f126ba7-f24f-4484-810d-388f8b5c3742 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06" status: 200 len: 1367 microversion: 2.1 time: 0.147538 Sep 06 01:16:58.594631 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 419/813] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:58 2022] GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:16:59.617614 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-da2bd252-1907-4c37-bc3a-1ed523c4d8e4 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:16:59.618312 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-da2bd252-1907-4c37-bc3a-1ed523c4d8e4 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: 35b05aea-d090-4dfc-ac48-250f71e9da06] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:16:59.624493 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da2bd252-1907-4c37-bc3a-1ed523c4d8e4 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:59.625020 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da2bd252-1907-4c37-bc3a-1ed523c4d8e4 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:59.625456 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da2bd252-1907-4c37-bc3a-1ed523c4d8e4 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:59.626167 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da2bd252-1907-4c37-bc3a-1ed523c4d8e4 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:16:59.626614 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da2bd252-1907-4c37-bc3a-1ed523c4d8e4 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:16:59.627035 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da2bd252-1907-4c37-bc3a-1ed523c4d8e4 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:16:59.759347 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-da2bd252-1907-4c37-bc3a-1ed523c4d8e4 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:16:59.767092 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-da2bd252-1907-4c37-bc3a-1ed523c4d8e4 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06" status: 200 len: 1367 microversion: 2.1 time: 0.154169 Sep 06 01:16:59.767715 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 395/814] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:16:59 2022] GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:17:00.790452 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-d8096f08-d788-4583-b4ee-2747f2d331b8 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:00.791067 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-d8096f08-d788-4583-b4ee-2747f2d331b8 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: 35b05aea-d090-4dfc-ac48-250f71e9da06] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:00.797830 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d8096f08-d788-4583-b4ee-2747f2d331b8 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:00.798316 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d8096f08-d788-4583-b4ee-2747f2d331b8 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:00.798749 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d8096f08-d788-4583-b4ee-2747f2d331b8 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:00.799453 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d8096f08-d788-4583-b4ee-2747f2d331b8 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:00.799932 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d8096f08-d788-4583-b4ee-2747f2d331b8 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:00.800359 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d8096f08-d788-4583-b4ee-2747f2d331b8 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:00.926322 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-d8096f08-d788-4583-b4ee-2747f2d331b8 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:00.934441 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-d8096f08-d788-4583-b4ee-2747f2d331b8 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06" status: 200 len: 1367 microversion: 2.1 time: 0.147929 Sep 06 01:17:00.935006 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 420/815] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:00 2022] GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:17:01.957461 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cfce6485-0ebc-476e-97a6-f95da3f833ee tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:01.958067 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cfce6485-0ebc-476e-97a6-f95da3f833ee tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: 35b05aea-d090-4dfc-ac48-250f71e9da06] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:01.965110 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfce6485-0ebc-476e-97a6-f95da3f833ee tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:01.965584 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfce6485-0ebc-476e-97a6-f95da3f833ee tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:01.966015 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfce6485-0ebc-476e-97a6-f95da3f833ee tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:01.966694 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfce6485-0ebc-476e-97a6-f95da3f833ee tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:01.967142 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfce6485-0ebc-476e-97a6-f95da3f833ee tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:01.967559 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfce6485-0ebc-476e-97a6-f95da3f833ee tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:02.098480 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-cfce6485-0ebc-476e-97a6-f95da3f833ee tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:02.106608 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cfce6485-0ebc-476e-97a6-f95da3f833ee tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06" status: 200 len: 1367 microversion: 2.1 time: 0.153062 Sep 06 01:17:02.107158 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 396/816] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:01 2022] GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:17:03.118520 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-89509ef5-c0a7-4fb6-a782-c063f911fd18 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:03.119047 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-89509ef5-c0a7-4fb6-a782-c063f911fd18 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:03.125639 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-89509ef5-c0a7-4fb6-a782-c063f911fd18 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:03.126121 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-89509ef5-c0a7-4fb6-a782-c063f911fd18 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:03.126556 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-89509ef5-c0a7-4fb6-a782-c063f911fd18 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:03.127242 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-89509ef5-c0a7-4fb6-a782-c063f911fd18 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:03.127696 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-89509ef5-c0a7-4fb6-a782-c063f911fd18 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:03.128142 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-89509ef5-c0a7-4fb6-a782-c063f911fd18 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:03.128538 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-15ffe422-fa8e-4361-944f-006dd59b4714 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:03.129151 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-15ffe422-fa8e-4361-944f-006dd59b4714 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: 35b05aea-d090-4dfc-ac48-250f71e9da06] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:03.135504 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15ffe422-fa8e-4361-944f-006dd59b4714 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:03.136013 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15ffe422-fa8e-4361-944f-006dd59b4714 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:03.136447 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15ffe422-fa8e-4361-944f-006dd59b4714 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:03.137132 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15ffe422-fa8e-4361-944f-006dd59b4714 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:03.137597 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15ffe422-fa8e-4361-944f-006dd59b4714 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:03.138002 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15ffe422-fa8e-4361-944f-006dd59b4714 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:03.211017 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.objects.instance [None req-89509ef5-c0a7-4fb6-a782-c063f911fd18 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lazy-loading 'services' on Instance uuid ce3f054d-45b3-41c2-9f87-c32efa7bc088 {{(pid=120580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 01:17:03.266210 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-15ffe422-fa8e-4361-944f-006dd59b4714 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:03.274885 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-15ffe422-fa8e-4361-944f-006dd59b4714 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06" status: 200 len: 1367 microversion: 2.1 time: 0.150088 Sep 06 01:17:03.275451 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 397/817] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:03 2022] GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:17:03.286559 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-89509ef5-c0a7-4fb6-a782-c063f911fd18 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088/os-volume_attachments/e5c8d087-d284-4a06-9778-63333c2d17cd" status: 202 len: 0 microversion: 2.1 time: 0.171856 Sep 06 01:17:03.287867 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 421/818] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Sep 6 01:17:03 2022] DELETE /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088/os-volume_attachments/e5c8d087-d284-4a06-9778-63333c2d17cd => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 01:17:03.297480 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6dc242a5-9a2f-4294-845e-c8e9e4f5fedd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:03.299722 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6dc242a5-9a2f-4294-845e-c8e9e4f5fedd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:03.306262 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6dc242a5-9a2f-4294-845e-c8e9e4f5fedd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:03.306755 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6dc242a5-9a2f-4294-845e-c8e9e4f5fedd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:03.307204 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6dc242a5-9a2f-4294-845e-c8e9e4f5fedd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:03.307981 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6dc242a5-9a2f-4294-845e-c8e9e4f5fedd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:03.308590 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6dc242a5-9a2f-4294-845e-c8e9e4f5fedd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:03.309029 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6dc242a5-9a2f-4294-845e-c8e9e4f5fedd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:03.342409 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6dc242a5-9a2f-4294-845e-c8e9e4f5fedd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049116 Sep 06 01:17:03.342959 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 398/819] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 6 01:17:03 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:17:03.784412 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-cae15fc5-cb87-4d38-a4f3-436f58954110 req-a52968e9-f23b-4c6f-a1a9-e00b6b61fffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35b05aea-d090-4dfc-ac48-250f71e9da06", "name": "network-vif-plugged", "status": "completed", "tag": "5a34555a-ae18-454c-8599-cc82f05f0e3c"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:17:03.794501 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-cae15fc5-cb87-4d38-a4f3-436f58954110 req-a52968e9-f23b-4c6f-a1a9-e00b6b61fffc service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:03.794974 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-cae15fc5-cb87-4d38-a4f3-436f58954110 req-a52968e9-f23b-4c6f-a1a9-e00b6b61fffc service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:03.795404 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-cae15fc5-cb87-4d38-a4f3-436f58954110 req-a52968e9-f23b-4c6f-a1a9-e00b6b61fffc service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:03.806854 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.compute.server_external_events [req-cae15fc5-cb87-4d38-a4f3-436f58954110 req-a52968e9-f23b-4c6f-a1a9-e00b6b61fffc service nova] Creating event network-vif-plugged:5a34555a-ae18-454c-8599-cc82f05f0e3c for instance 35b05aea-d090-4dfc-ac48-250f71e9da06 on hv-cinder-84773 Sep 06 01:17:03.811506 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [req-cae15fc5-cb87-4d38-a4f3-436f58954110 req-a52968e9-f23b-4c6f-a1a9-e00b6b61fffc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031112 Sep 06 01:17:03.812196 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 422/820] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:17:04.298353 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2bbe0167-0049-4114-a9be-6953d1b1f626 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:04.298968 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2bbe0167-0049-4114-a9be-6953d1b1f626 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: 35b05aea-d090-4dfc-ac48-250f71e9da06] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:04.305935 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2bbe0167-0049-4114-a9be-6953d1b1f626 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:04.306423 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2bbe0167-0049-4114-a9be-6953d1b1f626 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:04.306857 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2bbe0167-0049-4114-a9be-6953d1b1f626 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:04.307548 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2bbe0167-0049-4114-a9be-6953d1b1f626 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:04.308035 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2bbe0167-0049-4114-a9be-6953d1b1f626 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:04.308460 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2bbe0167-0049-4114-a9be-6953d1b1f626 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:04.356089 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-2dfea924-f06d-4c45-a066-8774028bdac1 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:04.358292 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-2dfea924-f06d-4c45-a066-8774028bdac1 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:04.364699 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2dfea924-f06d-4c45-a066-8774028bdac1 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:04.365798 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2dfea924-f06d-4c45-a066-8774028bdac1 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:04.366241 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2dfea924-f06d-4c45-a066-8774028bdac1 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:04.366943 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2dfea924-f06d-4c45-a066-8774028bdac1 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:04.367427 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2dfea924-f06d-4c45-a066-8774028bdac1 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:04.367885 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2dfea924-f06d-4c45-a066-8774028bdac1 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:04.396567 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-2dfea924-f06d-4c45-a066-8774028bdac1 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045185 Sep 06 01:17:04.397131 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 423/821] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 6 01:17:04 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 06 01:17:04.442525 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-2bbe0167-0049-4114-a9be-6953d1b1f626 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:04.450386 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2bbe0167-0049-4114-a9be-6953d1b1f626 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06" status: 200 len: 1367 microversion: 2.1 time: 0.155903 Sep 06 01:17:04.450937 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 399/822] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:04 2022] GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:17:04.470806 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-113ee155-c9b1-4bb8-8874-b9128b1307a4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:04.471300 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-113ee155-c9b1-4bb8-8874-b9128b1307a4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:04.477816 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-113ee155-c9b1-4bb8-8874-b9128b1307a4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:04.478298 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-113ee155-c9b1-4bb8-8874-b9128b1307a4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:04.478737 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-113ee155-c9b1-4bb8-8874-b9128b1307a4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:04.479424 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-113ee155-c9b1-4bb8-8874-b9128b1307a4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:04.479919 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-113ee155-c9b1-4bb8-8874-b9128b1307a4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:04.480348 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-113ee155-c9b1-4bb8-8874-b9128b1307a4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:04.504967 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-113ee155-c9b1-4bb8-8874-b9128b1307a4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Going to try to terminate instance {{(pid=120580) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 01:17:04.576904 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-113ee155-c9b1-4bb8-8874-b9128b1307a4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 204 len: 0 microversion: 2.1 time: 0.109615 Sep 06 01:17:04.577522 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 424/823] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 6 01:17:04 2022] DELETE /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 01:17:04.586048 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ced79da0-53e1-4656-86bd-19dc7b6fb6f4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:04.586667 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ced79da0-53e1-4656-86bd-19dc7b6fb6f4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:04.592769 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ced79da0-53e1-4656-86bd-19dc7b6fb6f4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:04.593252 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ced79da0-53e1-4656-86bd-19dc7b6fb6f4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:04.593693 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ced79da0-53e1-4656-86bd-19dc7b6fb6f4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:04.594381 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ced79da0-53e1-4656-86bd-19dc7b6fb6f4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:04.594842 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ced79da0-53e1-4656-86bd-19dc7b6fb6f4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:04.595269 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ced79da0-53e1-4656-86bd-19dc7b6fb6f4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:04.727921 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-ced79da0-53e1-4656-86bd-19dc7b6fb6f4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:04.735869 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ced79da0-53e1-4656-86bd-19dc7b6fb6f4 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1690 microversion: 2.1 time: 0.154184 Sep 06 01:17:04.736555 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 400/824] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:04 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:17:05.473436 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-6b6a3b32-4fe0-4155-95bc-e3dc3913fb84 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:05.474140 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-6b6a3b32-4fe0-4155-95bc-e3dc3913fb84 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: 35b05aea-d090-4dfc-ac48-250f71e9da06] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:05.476082 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell0:SELECT=6 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:17:05.481592 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6b6a3b32-4fe0-4155-95bc-e3dc3913fb84 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:05.482070 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6b6a3b32-4fe0-4155-95bc-e3dc3913fb84 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:05.482499 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6b6a3b32-4fe0-4155-95bc-e3dc3913fb84 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:05.483185 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6b6a3b32-4fe0-4155-95bc-e3dc3913fb84 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:05.483633 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6b6a3b32-4fe0-4155-95bc-e3dc3913fb84 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:05.484080 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6b6a3b32-4fe0-4155-95bc-e3dc3913fb84 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:05.612642 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-6b6a3b32-4fe0-4155-95bc-e3dc3913fb84 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:05.620642 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-6b6a3b32-4fe0-4155-95bc-e3dc3913fb84 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06" status: 200 len: 1367 microversion: 2.1 time: 0.151484 Sep 06 01:17:05.621203 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 425/825] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:05 2022] GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:17:05.758543 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a6350896-78eb-43e4-ba9c-b31ee70df260 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:05.759184 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a6350896-78eb-43e4-ba9c-b31ee70df260 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:05.761161 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:17:05.761801 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:17:05.768680 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6350896-78eb-43e4-ba9c-b31ee70df260 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:05.769165 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6350896-78eb-43e4-ba9c-b31ee70df260 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:05.769595 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6350896-78eb-43e4-ba9c-b31ee70df260 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:05.770276 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6350896-78eb-43e4-ba9c-b31ee70df260 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:05.770724 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6350896-78eb-43e4-ba9c-b31ee70df260 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:05.771141 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6350896-78eb-43e4-ba9c-b31ee70df260 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:05.898559 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-a6350896-78eb-43e4-ba9c-b31ee70df260 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:05.906186 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a6350896-78eb-43e4-ba9c-b31ee70df260 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1690 microversion: 2.1 time: 0.151638 Sep 06 01:17:05.906741 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 401/826] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:05 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1690 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:17:06.643421 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-fc4ed696-ecbf-4e88-b17a-1115f1d4d18b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:06.644060 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-fc4ed696-ecbf-4e88-b17a-1115f1d4d18b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: 35b05aea-d090-4dfc-ac48-250f71e9da06] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:06.651048 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fc4ed696-ecbf-4e88-b17a-1115f1d4d18b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:06.651519 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fc4ed696-ecbf-4e88-b17a-1115f1d4d18b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:06.651982 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fc4ed696-ecbf-4e88-b17a-1115f1d4d18b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:06.652667 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fc4ed696-ecbf-4e88-b17a-1115f1d4d18b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:06.653120 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fc4ed696-ecbf-4e88-b17a-1115f1d4d18b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:06.653546 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fc4ed696-ecbf-4e88-b17a-1115f1d4d18b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:06.783475 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-fc4ed696-ecbf-4e88-b17a-1115f1d4d18b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:06.791204 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-fc4ed696-ecbf-4e88-b17a-1115f1d4d18b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06" status: 200 len: 1367 microversion: 2.1 time: 0.151584 Sep 06 01:17:06.792052 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 426/827] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:06 2022] GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:17:06.930033 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2e713f52-d589-44e2-a279-3f25306abd16 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:06.930643 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2e713f52-d589-44e2-a279-3f25306abd16 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:06.937131 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e713f52-d589-44e2-a279-3f25306abd16 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:06.937603 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e713f52-d589-44e2-a279-3f25306abd16 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:06.938033 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e713f52-d589-44e2-a279-3f25306abd16 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:06.938715 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e713f52-d589-44e2-a279-3f25306abd16 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:06.939167 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e713f52-d589-44e2-a279-3f25306abd16 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:06.939583 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e713f52-d589-44e2-a279-3f25306abd16 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:06.957771 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:17:07.070323 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-2e713f52-d589-44e2-a279-3f25306abd16 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:07.077678 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2e713f52-d589-44e2-a279-3f25306abd16 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1690 microversion: 2.1 time: 0.152000 Sep 06 01:17:07.078236 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 402/828] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:06 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1690 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:17:07.814450 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-044eaf7c-4a29-4c20-b2e1-9eb0dc877981 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:07.815057 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-044eaf7c-4a29-4c20-b2e1-9eb0dc877981 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: 35b05aea-d090-4dfc-ac48-250f71e9da06] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:07.821526 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-044eaf7c-4a29-4c20-b2e1-9eb0dc877981 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:07.821998 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-044eaf7c-4a29-4c20-b2e1-9eb0dc877981 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:07.822425 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-044eaf7c-4a29-4c20-b2e1-9eb0dc877981 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:07.823118 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-044eaf7c-4a29-4c20-b2e1-9eb0dc877981 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:07.823563 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-044eaf7c-4a29-4c20-b2e1-9eb0dc877981 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:07.824006 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-044eaf7c-4a29-4c20-b2e1-9eb0dc877981 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:07.951154 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-044eaf7c-4a29-4c20-b2e1-9eb0dc877981 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:07.958839 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-044eaf7c-4a29-4c20-b2e1-9eb0dc877981 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06" status: 200 len: 1367 microversion: 2.1 time: 0.148265 Sep 06 01:17:07.960043 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 427/829] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:07 2022] GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:17:08.099789 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3182cae7-ad2f-4ba4-80c5-19b2c8451357 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:08.100895 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3182cae7-ad2f-4ba4-80c5-19b2c8451357 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:08.108160 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3182cae7-ad2f-4ba4-80c5-19b2c8451357 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:08.108634 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3182cae7-ad2f-4ba4-80c5-19b2c8451357 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:08.109064 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3182cae7-ad2f-4ba4-80c5-19b2c8451357 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:08.109757 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3182cae7-ad2f-4ba4-80c5-19b2c8451357 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:08.110204 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3182cae7-ad2f-4ba4-80c5-19b2c8451357 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:08.110623 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3182cae7-ad2f-4ba4-80c5-19b2c8451357 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:08.238321 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-3182cae7-ad2f-4ba4-80c5-19b2c8451357 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:08.246509 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3182cae7-ad2f-4ba4-80c5-19b2c8451357 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1690 microversion: 2.1 time: 0.150613 Sep 06 01:17:08.247064 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 403/830] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:08 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1690 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:17:08.981709 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-37d492cc-fb2c-45d0-857c-e450eecbac86 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:08.982319 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-37d492cc-fb2c-45d0-857c-e450eecbac86 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: 35b05aea-d090-4dfc-ac48-250f71e9da06] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:08.988693 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-37d492cc-fb2c-45d0-857c-e450eecbac86 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:08.989172 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-37d492cc-fb2c-45d0-857c-e450eecbac86 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:08.989606 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-37d492cc-fb2c-45d0-857c-e450eecbac86 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:08.990289 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-37d492cc-fb2c-45d0-857c-e450eecbac86 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:08.990742 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-37d492cc-fb2c-45d0-857c-e450eecbac86 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:08.991162 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-37d492cc-fb2c-45d0-857c-e450eecbac86 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:09.128710 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-37d492cc-fb2c-45d0-857c-e450eecbac86 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:09.136887 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-37d492cc-fb2c-45d0-857c-e450eecbac86 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06" status: 200 len: 1557 microversion: 2.1 time: 0.159008 Sep 06 01:17:09.137466 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 428/831] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:08 2022] GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06 => generated 1557 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:17:09.159208 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1074aa2a-38f6-44d7-9c45-65f19cffbb3d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:09.159716 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1074aa2a-38f6-44d7-9c45-65f19cffbb3d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: 35b05aea-d090-4dfc-ac48-250f71e9da06] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:09.166817 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1074aa2a-38f6-44d7-9c45-65f19cffbb3d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:09.167295 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1074aa2a-38f6-44d7-9c45-65f19cffbb3d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:09.167725 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1074aa2a-38f6-44d7-9c45-65f19cffbb3d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:09.168452 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1074aa2a-38f6-44d7-9c45-65f19cffbb3d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:09.169240 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1074aa2a-38f6-44d7-9c45-65f19cffbb3d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:09.169663 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1074aa2a-38f6-44d7-9c45-65f19cffbb3d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:09.243013 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1074aa2a-38f6-44d7-9c45-65f19cffbb3d tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087629 Sep 06 01:17:09.243608 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 404/832] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Sep 6 01:17:09 2022] GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:17:09.272881 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-4e944daa-fae4-47da-bd96-32fd8cdff491 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:09.273499 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-4e944daa-fae4-47da-bd96-32fd8cdff491 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:09.279550 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4e944daa-fae4-47da-bd96-32fd8cdff491 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:09.280068 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4e944daa-fae4-47da-bd96-32fd8cdff491 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:09.280690 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4e944daa-fae4-47da-bd96-32fd8cdff491 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:09.281470 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4e944daa-fae4-47da-bd96-32fd8cdff491 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:09.282021 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4e944daa-fae4-47da-bd96-32fd8cdff491 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:09.282450 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4e944daa-fae4-47da-bd96-32fd8cdff491 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:09.455323 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:17:09.692382 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-4e944daa-fae4-47da-bd96-32fd8cdff491 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:09.700721 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-4e944daa-fae4-47da-bd96-32fd8cdff491 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1690 microversion: 2.1 time: 0.432307 Sep 06 01:17:09.701605 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 429/833] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:09 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1690 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:17:10.347241 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-487b5803-9e2f-4084-92be-111c15d6a2b9 req-98a7c127-f161-41bf-a850-ef4357cc97eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35b05aea-d090-4dfc-ac48-250f71e9da06", "tag": "5a34555a-ae18-454c-8599-cc82f05f0e3c"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:17:10.357460 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-487b5803-9e2f-4084-92be-111c15d6a2b9 req-98a7c127-f161-41bf-a850-ef4357cc97eb service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:10.358326 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-487b5803-9e2f-4084-92be-111c15d6a2b9 req-98a7c127-f161-41bf-a850-ef4357cc97eb service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:10.358934 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-487b5803-9e2f-4084-92be-111c15d6a2b9 req-98a7c127-f161-41bf-a850-ef4357cc97eb service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:10.370530 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-487b5803-9e2f-4084-92be-111c15d6a2b9 req-98a7c127-f161-41bf-a850-ef4357cc97eb service nova] Creating event network-changed:5a34555a-ae18-454c-8599-cc82f05f0e3c for instance 35b05aea-d090-4dfc-ac48-250f71e9da06 on hv-cinder-84773 Sep 06 01:17:10.375510 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-487b5803-9e2f-4084-92be-111c15d6a2b9 req-98a7c127-f161-41bf-a850-ef4357cc97eb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099716 Sep 06 01:17:10.376472 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 405/834] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:17:10.590736 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-0c58def3-ea1e-4de1-bbd0-ea7d6484f403 req-0e191d11-f5d7-43eb-9d71-2eab05972854 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce3f054d-45b3-41c2-9f87-c32efa7bc088", "name": "network-vif-deleted", "tag": "5bfb66f4-238b-4ee5-8ff6-581b693fd4eb"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:17:10.609382 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-0c58def3-ea1e-4de1-bbd0-ea7d6484f403 req-0e191d11-f5d7-43eb-9d71-2eab05972854 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:10.610259 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-0c58def3-ea1e-4de1-bbd0-ea7d6484f403 req-0e191d11-f5d7-43eb-9d71-2eab05972854 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:10.612297 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-0c58def3-ea1e-4de1-bbd0-ea7d6484f403 req-0e191d11-f5d7-43eb-9d71-2eab05972854 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:10.633211 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.compute.server_external_events [req-0c58def3-ea1e-4de1-bbd0-ea7d6484f403 req-0e191d11-f5d7-43eb-9d71-2eab05972854 service nova] Creating event network-vif-deleted:5bfb66f4-238b-4ee5-8ff6-581b693fd4eb for instance ce3f054d-45b3-41c2-9f87-c32efa7bc088 on hv-cinder-84773 Sep 06 01:17:10.645583 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [req-0c58def3-ea1e-4de1-bbd0-ea7d6484f403 req-0e191d11-f5d7-43eb-9d71-2eab05972854 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164024 Sep 06 01:17:10.650735 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 430/835] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:17:10.728637 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5fe98622-5edf-4ebe-bc7a-bec05b310eef tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:10.735316 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5fe98622-5edf-4ebe-bc7a-bec05b310eef tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:10.749242 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fe98622-5edf-4ebe-bc7a-bec05b310eef tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:10.749752 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fe98622-5edf-4ebe-bc7a-bec05b310eef tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:10.750186 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fe98622-5edf-4ebe-bc7a-bec05b310eef tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:10.751103 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fe98622-5edf-4ebe-bc7a-bec05b310eef tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:10.752362 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fe98622-5edf-4ebe-bc7a-bec05b310eef tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:10.752950 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fe98622-5edf-4ebe-bc7a-bec05b310eef tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:10.792685 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fe98622-5edf-4ebe-bc7a-bec05b310eef tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:10.793422 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fe98622-5edf-4ebe-bc7a-bec05b310eef tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:10.794010 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fe98622-5edf-4ebe-bc7a-bec05b310eef tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:10.794611 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-5fe98622-5edf-4ebe-bc7a-bec05b310eef tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lazy-loading 'fault' on Instance uuid ce3f054d-45b3-41c2-9f87-c32efa7bc088 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 01:17:10.839190 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-5fe98622-5edf-4ebe-bc7a-bec05b310eef tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:10.847731 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5fe98622-5edf-4ebe-bc7a-bec05b310eef tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 200 len: 1336 microversion: 2.1 time: 0.125689 Sep 06 01:17:10.849037 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 406/836] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:10 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 1336 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:17:11.141522 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-8637a8f7-75d9-4b98-9432-3420959baf9b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:11.142190 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-8637a8f7-75d9-4b98-9432-3420959baf9b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:11.149451 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8637a8f7-75d9-4b98-9432-3420959baf9b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:11.149970 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8637a8f7-75d9-4b98-9432-3420959baf9b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:11.150406 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8637a8f7-75d9-4b98-9432-3420959baf9b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:11.151106 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8637a8f7-75d9-4b98-9432-3420959baf9b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:11.151585 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8637a8f7-75d9-4b98-9432-3420959baf9b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:11.152043 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8637a8f7-75d9-4b98-9432-3420959baf9b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:11.177585 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-8637a8f7-75d9-4b98-9432-3420959baf9b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441/ips" status: 200 len: 152 microversion: 2.20 time: 0.161034 Sep 06 01:17:11.178875 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 431/837] 10.222.0.23 () {60 vars in 1289 bytes} [Tue Sep 6 01:17:11 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441/ips => generated 152 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 01:17:11.872309 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-baf1a80b-171a-426f-8997-e9e25722e2ac tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:11.873082 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-baf1a80b-171a-426f-8997-e9e25722e2ac tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: ce3f054d-45b3-41c2-9f87-c32efa7bc088] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:11.881972 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-baf1a80b-171a-426f-8997-e9e25722e2ac tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:11.882241 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-baf1a80b-171a-426f-8997-e9e25722e2ac tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:11.882565 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-baf1a80b-171a-426f-8997-e9e25722e2ac tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:11.883285 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-baf1a80b-171a-426f-8997-e9e25722e2ac tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:11.883742 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-baf1a80b-171a-426f-8997-e9e25722e2ac tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:11.884200 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-baf1a80b-171a-426f-8997-e9e25722e2ac tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:11.902429 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-baf1a80b-171a-426f-8997-e9e25722e2ac tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] HTTP exception thrown: Instance ce3f054d-45b3-41c2-9f87-c32efa7bc088 could not be found. Sep 06 01:17:11.905195 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-baf1a80b-171a-426f-8997-e9e25722e2ac tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Request method failure captured: Sep 06 01:17:11.905195 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 HTTP/1.1 Sep 06 01:17:11.905195 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept: application/json Sep 06 01:17:11.905195 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept-Encoding: identity Sep 06 01:17:11.905195 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Connection: close Sep 06 01:17:11.905195 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Length: 0 Sep 06 01:17:11.905195 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Type: application/json Sep 06 01:17:11.905195 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Host: 10.222.0.23 Sep 06 01:17:11.905195 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Openstack-System-Scope: None Sep 06 01:17:11.905195 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Sep 06 01:17:11.905195 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjFp5NMcwKuEUHo2486ufaQ1_DZDxLGpUTLrr7cY7CHRRWjkMwkS2RH-midIYAwqOB5ZPR8PbCADD5XlDFDs-1j0nZ0VMlxZ2i03OyHDj--OqiIIDDm8dNS5bEMfqSgxwbC1vfe-w2IKMjXfHxinzodZYhHEbGdxznmqwbs3qXAmEUuhE Sep 06 01:17:11.905195 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Id: None Sep 06 01:17:11.905195 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Name: None Sep 06 01:17:11.905195 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Identity-Status: Confirmed Sep 06 01:17:11.905195 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Is-Admin-Project: True Sep 06 01:17:11.905195 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Id: default Sep 06 01:17:11.905195 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Name: Default Sep 06 01:17:11.905195 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Id: 91ee5ad0b4064b9d8a038980786072cb Sep 06 01:17:11.905195 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-317724904 Sep 06 01:17:11.905195 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Role: reader,member Sep 06 01:17:11.905195 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Roles: reader,member Sep 06 01:17:11.906715 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ee5ad0b4064b9d8a038980786072cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/91ee5ad0b4064b9d8a038980786072cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_91ee5ad0b4064b9d8a038980786072cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ee5ad0b4064b9d8a038980786072cb"}]}] Sep 06 01:17:11.906715 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant: tempest-ServerRescueNegativeTestJSON-317724904 Sep 06 01:17:11.906715 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Id: 91ee5ad0b4064b9d8a038980786072cb Sep 06 01:17:11.906715 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-317724904 Sep 06 01:17:11.906715 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User: tempest-ServerRescueNegativeTestJSON-317724904-project Sep 06 01:17:11.906715 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Id: default Sep 06 01:17:11.906715 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Name: Default Sep 06 01:17:11.906715 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Id: 703464e4a9524efaa8fdfc1870158cbb Sep 06 01:17:11.906715 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Name: tempest-ServerRescueNegativeTestJSON-317724904-project Sep 06 01:17:11.906715 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: method: > Sep 06 01:17:11.906715 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: exception: Instance ce3f054d-45b3-41c2-9f87-c32efa7bc088 could not be found. Sep 06 01:17:11.906715 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: action_args: {'id': 'ce3f054d-45b3-41c2-9f87-c32efa7bc088'} Sep 06 01:17:11.907492 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:17:11.907492 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:17:11.907492 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 01:17:11.907492 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 01:17:11.907492 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 01:17:11.907492 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 01:17:11.907492 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 01:17:11.907492 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 01:17:11.907492 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 01:17:11.907492 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 01:17:11.907492 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce3f054d-45b3-41c2-9f87-c32efa7bc088 could not be found. Sep 06 01:17:11.907492 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:17:11.907492 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:17:11.907492 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:17:11.907492 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:17:11.907492 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:17:11.907492 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:17:11.907492 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:17:11.907492 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:17:11.907492 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:17:11.908799 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:17:11.908799 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 01:17:11.908799 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 01:17:11.908799 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 01:17:11.908799 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 01:17:11.908799 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 01:17:11.908799 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:17:11.908799 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce3f054d-45b3-41c2-9f87-c32efa7bc088 could not be found. Sep 06 01:17:11.908799 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:17:11.908799 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:17:11.908799 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:17:11.908799 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:17:11.908799 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:17:11.908799 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:17:11.908799 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:17:11.908799 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:17:11.908799 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce3f054d-45b3-41c2-9f87-c32efa7bc088 could not be found. Sep 06 01:17:11.908799 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:17:11.909870 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-baf1a80b-171a-426f-8997-e9e25722e2ac tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Returning 404 to user: Instance ce3f054d-45b3-41c2-9f87-c32efa7bc088 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:17:11.909870 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-baf1a80b-171a-426f-8997-e9e25722e2ac tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088" status: 404 len: 111 microversion: 2.1 time: 0.039539 Sep 06 01:17:11.909870 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 407/838] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:11 2022] GET /compute/v2.1/servers/ce3f054d-45b3-41c2-9f87-c32efa7bc088 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 01:17:11.916766 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-82aaa4e0-2f2e-4db8-b194-67e366c9a7f5 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '.version_select at 0x7fb06df71700>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:11.936865 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-82aaa4e0-2f2e-4db8-b194-67e366c9a7f5 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2119531536" status: 202 len: 0 microversion: 2.1 time: 0.024722 Sep 06 01:17:11.937818 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 432/839] 10.222.0.23 () {58 vars in 1221 bytes} [Tue Sep 6 01:17:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2119531536 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 01:17:13.158879 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-00be0527-fb98-46c6-baba-5ac4e5141d75 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:13.161071 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-00be0527-fb98-46c6-baba-5ac4e5141d75 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:13.168185 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-00be0527-fb98-46c6-baba-5ac4e5141d75 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:13.168665 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-00be0527-fb98-46c6-baba-5ac4e5141d75 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:13.169097 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-00be0527-fb98-46c6-baba-5ac4e5141d75 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:13.169774 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-00be0527-fb98-46c6-baba-5ac4e5141d75 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:13.170220 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-00be0527-fb98-46c6-baba-5ac4e5141d75 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:13.170636 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-00be0527-fb98-46c6-baba-5ac4e5141d75 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:13.201983 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-00be0527-fb98-46c6-baba-5ac4e5141d75 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047079 Sep 06 01:17:13.202515 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 408/840] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 6 01:17:13 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 01:17:13.264113 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-53d46444-1f7b-44b3-a1b3-2966b60594fa tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:13.264615 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-53d46444-1f7b-44b3-a1b3-2966b60594fa tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:13.271109 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-53d46444-1f7b-44b3-a1b3-2966b60594fa tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:13.271648 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-53d46444-1f7b-44b3-a1b3-2966b60594fa tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:13.272110 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-53d46444-1f7b-44b3-a1b3-2966b60594fa tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:13.272794 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-53d46444-1f7b-44b3-a1b3-2966b60594fa tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:13.273279 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-53d46444-1f7b-44b3-a1b3-2966b60594fa tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:13.273702 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-53d46444-1f7b-44b3-a1b3-2966b60594fa tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:13.297854 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-53d46444-1f7b-44b3-a1b3-2966b60594fa tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Going to try to terminate instance {{(pid=120580) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 01:17:13.371260 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-53d46444-1f7b-44b3-a1b3-2966b60594fa tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 204 len: 0 microversion: 2.1 time: 0.111109 Sep 06 01:17:13.372129 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 433/841] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 6 01:17:13 2022] DELETE /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 01:17:13.381742 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d059442c-585f-4e3c-b8dc-c1d48e729aba tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:13.382351 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d059442c-585f-4e3c-b8dc-c1d48e729aba tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:13.388571 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d059442c-585f-4e3c-b8dc-c1d48e729aba tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:13.389321 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d059442c-585f-4e3c-b8dc-c1d48e729aba tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:13.389788 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d059442c-585f-4e3c-b8dc-c1d48e729aba tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:13.390478 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d059442c-585f-4e3c-b8dc-c1d48e729aba tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:13.390937 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d059442c-585f-4e3c-b8dc-c1d48e729aba tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:13.391364 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d059442c-585f-4e3c-b8dc-c1d48e729aba tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:13.446736 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-30105587-673b-456f-9dcd-0ce553f82f7f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:17:13.447350 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-30105587-673b-456f-9dcd-0ce553f82f7f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:13.453534 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-30105587-673b-456f-9dcd-0ce553f82f7f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:13.454015 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-30105587-673b-456f-9dcd-0ce553f82f7f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:13.454445 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-30105587-673b-456f-9dcd-0ce553f82f7f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:13.455129 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-30105587-673b-456f-9dcd-0ce553f82f7f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:13.455578 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-30105587-673b-456f-9dcd-0ce553f82f7f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:13.456021 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-30105587-673b-456f-9dcd-0ce553f82f7f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:13.480332 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.objects.instance [None req-30105587-673b-456f-9dcd-0ce553f82f7f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lazy-loading 'flavor' on Instance uuid 366390df-669b-48b1-b741-56d5fdd64441 {{(pid=120580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 01:17:13.523947 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-d059442c-585f-4e3c-b8dc-c1d48e729aba tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:13.532155 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d059442c-585f-4e3c-b8dc-c1d48e729aba tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1672 microversion: 2.1 time: 0.154912 Sep 06 01:17:13.532950 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 409/842] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:13 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:17:13.672953 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-30105587-673b-456f-9dcd-0ce553f82f7f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "POST /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441/action" status: 202 len: 0 microversion: 2.20 time: 0.230422 Sep 06 01:17:13.676333 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 434/843] 10.222.0.23 () {62 vars in 1319 bytes} [Tue Sep 6 01:17:13 2022] POST /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 06 01:17:13.683644 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-619a2aa4-b1e6-4d29-b74c-99ba51a04261 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:13.684766 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-619a2aa4-b1e6-4d29-b74c-99ba51a04261 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:13.692716 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-619a2aa4-b1e6-4d29-b74c-99ba51a04261 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:13.693363 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-619a2aa4-b1e6-4d29-b74c-99ba51a04261 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:13.694778 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-619a2aa4-b1e6-4d29-b74c-99ba51a04261 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:13.695671 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-619a2aa4-b1e6-4d29-b74c-99ba51a04261 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:13.699808 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-619a2aa4-b1e6-4d29-b74c-99ba51a04261 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:13.699808 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-619a2aa4-b1e6-4d29-b74c-99ba51a04261 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:13.843546 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-619a2aa4-b1e6-4d29-b74c-99ba51a04261 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:13.851604 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-619a2aa4-b1e6-4d29-b74c-99ba51a04261 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:13.853082 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-619a2aa4-b1e6-4d29-b74c-99ba51a04261 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:13.854239 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-619a2aa4-b1e6-4d29-b74c-99ba51a04261 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1724 microversion: 2.20 time: 0.176659 Sep 06 01:17:13.854792 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 410/844] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:17:13 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:17:14.557380 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-2ae455ab-748e-4332-bb0b-4eb73195d24b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:14.558082 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-2ae455ab-748e-4332-bb0b-4eb73195d24b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:14.565086 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2ae455ab-748e-4332-bb0b-4eb73195d24b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:14.565575 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2ae455ab-748e-4332-bb0b-4eb73195d24b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:14.566040 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2ae455ab-748e-4332-bb0b-4eb73195d24b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:14.566732 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2ae455ab-748e-4332-bb0b-4eb73195d24b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:14.567189 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2ae455ab-748e-4332-bb0b-4eb73195d24b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:14.567617 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2ae455ab-748e-4332-bb0b-4eb73195d24b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:14.695797 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-2ae455ab-748e-4332-bb0b-4eb73195d24b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:14.703483 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-2ae455ab-748e-4332-bb0b-4eb73195d24b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1672 microversion: 2.1 time: 0.151034 Sep 06 01:17:14.704082 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 435/845] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:14 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:17:14.844537 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-240b15ea-b303-4481-a805-a738ba6cddab tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:14.845060 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-240b15ea-b303-4481-a805-a738ba6cddab tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:14.851415 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-240b15ea-b303-4481-a805-a738ba6cddab tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:14.851929 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-240b15ea-b303-4481-a805-a738ba6cddab tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:14.852357 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-240b15ea-b303-4481-a805-a738ba6cddab tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:14.853036 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-240b15ea-b303-4481-a805-a738ba6cddab tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:14.853485 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-240b15ea-b303-4481-a805-a738ba6cddab tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:14.853905 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-240b15ea-b303-4481-a805-a738ba6cddab tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:14.878248 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-240b15ea-b303-4481-a805-a738ba6cddab tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 01:17:14.879781 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-1524e073-44bb-429c-a1f9-3876cfb841c3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:14.880430 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-1524e073-44bb-429c-a1f9-3876cfb841c3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:14.886779 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1524e073-44bb-429c-a1f9-3876cfb841c3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:14.887261 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1524e073-44bb-429c-a1f9-3876cfb841c3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:14.887699 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1524e073-44bb-429c-a1f9-3876cfb841c3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:14.888417 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1524e073-44bb-429c-a1f9-3876cfb841c3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:14.888872 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1524e073-44bb-429c-a1f9-3876cfb841c3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:14.889295 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1524e073-44bb-429c-a1f9-3876cfb841c3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:14.952911 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-240b15ea-b303-4481-a805-a738ba6cddab tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "DELETE /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 204 len: 0 microversion: 2.1 time: 0.111909 Sep 06 01:17:14.953486 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 411/846] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 6 01:17:14 2022] DELETE /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 01:17:14.962254 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6183d5c7-311c-4372-8384-005de314aeab tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:14.962947 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6183d5c7-311c-4372-8384-005de314aeab tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:14.968672 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6183d5c7-311c-4372-8384-005de314aeab tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:14.969149 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6183d5c7-311c-4372-8384-005de314aeab tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:14.969579 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6183d5c7-311c-4372-8384-005de314aeab tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:14.970262 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6183d5c7-311c-4372-8384-005de314aeab tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:14.970711 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6183d5c7-311c-4372-8384-005de314aeab tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:14.971128 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6183d5c7-311c-4372-8384-005de314aeab tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:15.055058 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-1524e073-44bb-429c-a1f9-3876cfb841c3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:15.063465 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-1524e073-44bb-429c-a1f9-3876cfb841c3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:15.065122 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-1524e073-44bb-429c-a1f9-3876cfb841c3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:15.066373 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-1524e073-44bb-429c-a1f9-3876cfb841c3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1724 microversion: 2.20 time: 0.190630 Sep 06 01:17:15.067012 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 436/847] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:17:14 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:17:15.114211 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-6183d5c7-311c-4372-8384-005de314aeab tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:15.122327 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6183d5c7-311c-4372-8384-005de314aeab tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1508 microversion: 2.1 time: 0.164598 Sep 06 01:17:15.122870 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 412/848] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:14 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:17:15.727413 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-03c46a8d-c805-4306-a300-27215b1ed8ed tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:15.728178 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-03c46a8d-c805-4306-a300-27215b1ed8ed tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:15.734673 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-03c46a8d-c805-4306-a300-27215b1ed8ed tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:15.735160 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-03c46a8d-c805-4306-a300-27215b1ed8ed tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:15.735601 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-03c46a8d-c805-4306-a300-27215b1ed8ed tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:15.736321 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-03c46a8d-c805-4306-a300-27215b1ed8ed tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:15.736782 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-03c46a8d-c805-4306-a300-27215b1ed8ed tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:15.737212 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-03c46a8d-c805-4306-a300-27215b1ed8ed tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:15.862301 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-03c46a8d-c805-4306-a300-27215b1ed8ed tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:15.869909 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-03c46a8d-c805-4306-a300-27215b1ed8ed tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1672 microversion: 2.1 time: 0.146864 Sep 06 01:17:15.870473 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 437/849] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:15 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1672 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:17:16.092536 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-461146f3-db58-4d62-906e-6b2c5fef8c78 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:16.093168 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-461146f3-db58-4d62-906e-6b2c5fef8c78 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:16.100288 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-461146f3-db58-4d62-906e-6b2c5fef8c78 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:16.100783 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-461146f3-db58-4d62-906e-6b2c5fef8c78 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:16.101229 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-461146f3-db58-4d62-906e-6b2c5fef8c78 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:16.101923 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-461146f3-db58-4d62-906e-6b2c5fef8c78 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:16.102384 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-461146f3-db58-4d62-906e-6b2c5fef8c78 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:16.102845 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-461146f3-db58-4d62-906e-6b2c5fef8c78 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:16.145611 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-3781f6e0-e8ef-43c6-9a7b-87f90884fd2a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:16.146240 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-3781f6e0-e8ef-43c6-9a7b-87f90884fd2a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:16.152742 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3781f6e0-e8ef-43c6-9a7b-87f90884fd2a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:16.153295 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3781f6e0-e8ef-43c6-9a7b-87f90884fd2a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:16.153798 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3781f6e0-e8ef-43c6-9a7b-87f90884fd2a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:16.154552 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3781f6e0-e8ef-43c6-9a7b-87f90884fd2a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:16.155091 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3781f6e0-e8ef-43c6-9a7b-87f90884fd2a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:16.155582 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3781f6e0-e8ef-43c6-9a7b-87f90884fd2a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:16.280533 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-461146f3-db58-4d62-906e-6b2c5fef8c78 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:16.288518 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-461146f3-db58-4d62-906e-6b2c5fef8c78 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:16.289963 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-461146f3-db58-4d62-906e-6b2c5fef8c78 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:16.291123 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-461146f3-db58-4d62-906e-6b2c5fef8c78 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1724 microversion: 2.20 time: 0.202540 Sep 06 01:17:16.291967 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 413/850] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:17:16 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:17:16.309441 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-3781f6e0-e8ef-43c6-9a7b-87f90884fd2a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:16.317072 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-3781f6e0-e8ef-43c6-9a7b-87f90884fd2a tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1508 microversion: 2.1 time: 0.175464 Sep 06 01:17:16.317627 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 438/851] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:16 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1508 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:17:16.893022 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-34a7c8f7-d3fa-431f-8272-d29e560fff26 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:16.893557 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-34a7c8f7-d3fa-431f-8272-d29e560fff26 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:16.899548 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34a7c8f7-d3fa-431f-8272-d29e560fff26 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:16.900057 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34a7c8f7-d3fa-431f-8272-d29e560fff26 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:16.900491 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34a7c8f7-d3fa-431f-8272-d29e560fff26 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:16.901180 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34a7c8f7-d3fa-431f-8272-d29e560fff26 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:16.901630 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34a7c8f7-d3fa-431f-8272-d29e560fff26 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:16.902048 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34a7c8f7-d3fa-431f-8272-d29e560fff26 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:17.030070 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-34a7c8f7-d3fa-431f-8272-d29e560fff26 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:17.038152 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-34a7c8f7-d3fa-431f-8272-d29e560fff26 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1672 microversion: 2.1 time: 0.149055 Sep 06 01:17:17.038700 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 414/852] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:16 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1672 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:17:17.316254 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-2e78fcb4-b3be-4a47-a37a-722f29b25215 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:17.316967 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-2e78fcb4-b3be-4a47-a37a-722f29b25215 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:17.319318 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=3,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:17:17.324423 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2e78fcb4-b3be-4a47-a37a-722f29b25215 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:17.324919 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2e78fcb4-b3be-4a47-a37a-722f29b25215 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:17.325359 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2e78fcb4-b3be-4a47-a37a-722f29b25215 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:17.326061 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2e78fcb4-b3be-4a47-a37a-722f29b25215 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:17.326523 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2e78fcb4-b3be-4a47-a37a-722f29b25215 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:17.326951 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2e78fcb4-b3be-4a47-a37a-722f29b25215 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:17.341251 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a7c33def-198d-4b3a-8c45-7dd0838b1e9b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:17.341862 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a7c33def-198d-4b3a-8c45-7dd0838b1e9b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:17.348593 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a7c33def-198d-4b3a-8c45-7dd0838b1e9b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:17.349077 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a7c33def-198d-4b3a-8c45-7dd0838b1e9b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:17.350280 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a7c33def-198d-4b3a-8c45-7dd0838b1e9b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:17.351135 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a7c33def-198d-4b3a-8c45-7dd0838b1e9b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:17.351596 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a7c33def-198d-4b3a-8c45-7dd0838b1e9b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:17.352046 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a7c33def-198d-4b3a-8c45-7dd0838b1e9b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:17.516004 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-2e78fcb4-b3be-4a47-a37a-722f29b25215 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:17.525222 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-2e78fcb4-b3be-4a47-a37a-722f29b25215 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:17.526900 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-2e78fcb4-b3be-4a47-a37a-722f29b25215 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:17.528181 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-2e78fcb4-b3be-4a47-a37a-722f29b25215 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1724 microversion: 2.20 time: 0.215933 Sep 06 01:17:17.535867 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 439/853] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:17:17 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:17:17.546868 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-a7c33def-198d-4b3a-8c45-7dd0838b1e9b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:17.555477 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a7c33def-198d-4b3a-8c45-7dd0838b1e9b tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1508 microversion: 2.1 time: 0.218588 Sep 06 01:17:17.556109 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 415/854] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:17 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1508 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:17:18.066921 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-335d56f0-054f-44c6-8846-e92ae4acca9a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:18.067850 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-335d56f0-054f-44c6-8846-e92ae4acca9a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:18.078698 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-335d56f0-054f-44c6-8846-e92ae4acca9a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:18.079440 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-335d56f0-054f-44c6-8846-e92ae4acca9a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:18.079998 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-335d56f0-054f-44c6-8846-e92ae4acca9a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:18.082139 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-335d56f0-054f-44c6-8846-e92ae4acca9a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:18.082701 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-335d56f0-054f-44c6-8846-e92ae4acca9a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:18.083243 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-335d56f0-054f-44c6-8846-e92ae4acca9a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:18.125004 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-cd203f5a-8e63-4fd8-8119-bcdfc50e53f5 req-a5054fc5-93f2-4e82-8182-a984c0f9d7ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88683beb-47e8-46e9-af24-4098c50a674a", "name": "network-vif-deleted", "tag": "1453654f-e3a0-4c17-8fd8-4d6102d43d13"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:17:18.137874 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-cd203f5a-8e63-4fd8-8119-bcdfc50e53f5 req-a5054fc5-93f2-4e82-8182-a984c0f9d7ca service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:18.138746 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-cd203f5a-8e63-4fd8-8119-bcdfc50e53f5 req-a5054fc5-93f2-4e82-8182-a984c0f9d7ca service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:18.139343 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-cd203f5a-8e63-4fd8-8119-bcdfc50e53f5 req-a5054fc5-93f2-4e82-8182-a984c0f9d7ca service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:18.153901 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-cd203f5a-8e63-4fd8-8119-bcdfc50e53f5 req-a5054fc5-93f2-4e82-8182-a984c0f9d7ca service nova] Creating event network-vif-deleted:1453654f-e3a0-4c17-8fd8-4d6102d43d13 for instance 88683beb-47e8-46e9-af24-4098c50a674a on hv-cinder-84773 Sep 06 01:17:18.161164 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-cd203f5a-8e63-4fd8-8119-bcdfc50e53f5 req-a5054fc5-93f2-4e82-8182-a984c0f9d7ca service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039616 Sep 06 01:17:18.163814 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 416/855] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 01:17:18.410196 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-335d56f0-054f-44c6-8846-e92ae4acca9a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:18.418998 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-335d56f0-054f-44c6-8846-e92ae4acca9a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 200 len: 1604 microversion: 2.1 time: 0.359976 Sep 06 01:17:18.419576 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 440/856] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:18 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 1604 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:17:18.556625 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d810ef5e-4e9b-4070-b5a0-6bc0a44972c0 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:18.557408 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d810ef5e-4e9b-4070-b5a0-6bc0a44972c0 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:18.564929 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d810ef5e-4e9b-4070-b5a0-6bc0a44972c0 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:18.565684 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d810ef5e-4e9b-4070-b5a0-6bc0a44972c0 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:18.566418 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d810ef5e-4e9b-4070-b5a0-6bc0a44972c0 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:18.567310 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d810ef5e-4e9b-4070-b5a0-6bc0a44972c0 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:18.567967 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d810ef5e-4e9b-4070-b5a0-6bc0a44972c0 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:18.570137 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d810ef5e-4e9b-4070-b5a0-6bc0a44972c0 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:18.578767 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-6a41ab3a-384c-43c4-85ea-a0676d7d6c3d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:18.580159 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-6a41ab3a-384c-43c4-85ea-a0676d7d6c3d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:18.591585 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6a41ab3a-384c-43c4-85ea-a0676d7d6c3d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:18.592202 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6a41ab3a-384c-43c4-85ea-a0676d7d6c3d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:18.592725 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6a41ab3a-384c-43c4-85ea-a0676d7d6c3d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:18.593509 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6a41ab3a-384c-43c4-85ea-a0676d7d6c3d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:18.594031 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6a41ab3a-384c-43c4-85ea-a0676d7d6c3d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:18.594526 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6a41ab3a-384c-43c4-85ea-a0676d7d6c3d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:18.632564 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6a41ab3a-384c-43c4-85ea-a0676d7d6c3d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:18.633308 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6a41ab3a-384c-43c4-85ea-a0676d7d6c3d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:18.633938 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6a41ab3a-384c-43c4-85ea-a0676d7d6c3d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:18.634584 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.objects.instance [None req-6a41ab3a-384c-43c4-85ea-a0676d7d6c3d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lazy-loading 'fault' on Instance uuid 88683beb-47e8-46e9-af24-4098c50a674a {{(pid=120580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 01:17:18.687426 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-6a41ab3a-384c-43c4-85ea-a0676d7d6c3d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:18.698045 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-6a41ab3a-384c-43c4-85ea-a0676d7d6c3d tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 200 len: 1312 microversion: 2.1 time: 0.122721 Sep 06 01:17:18.699466 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 441/857] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:18 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 1312 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:17:18.760935 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-d810ef5e-4e9b-4070-b5a0-6bc0a44972c0 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:18.772769 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-d810ef5e-4e9b-4070-b5a0-6bc0a44972c0 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:18.775016 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-d810ef5e-4e9b-4070-b5a0-6bc0a44972c0 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:18.776547 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d810ef5e-4e9b-4070-b5a0-6bc0a44972c0 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1724 microversion: 2.20 time: 0.225565 Sep 06 01:17:18.777427 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 417/858] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:17:18 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:17:19.442930 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-5e7baaa6-864b-4bd9-b131-180bf712d652 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:19.443529 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-5e7baaa6-864b-4bd9-b131-180bf712d652 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:19.450161 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5e7baaa6-864b-4bd9-b131-180bf712d652 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:19.450650 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5e7baaa6-864b-4bd9-b131-180bf712d652 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:19.451084 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5e7baaa6-864b-4bd9-b131-180bf712d652 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:19.452942 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5e7baaa6-864b-4bd9-b131-180bf712d652 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:19.453612 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5e7baaa6-864b-4bd9-b131-180bf712d652 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:19.454200 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5e7baaa6-864b-4bd9-b131-180bf712d652 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:19.471098 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.wsgi [None req-5e7baaa6-864b-4bd9-b131-180bf712d652 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] HTTP exception thrown: Instance c116182e-e47e-4655-a30d-5f8d52772fba could not be found. Sep 06 01:17:19.472984 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-5e7baaa6-864b-4bd9-b131-180bf712d652 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Request method failure captured: Sep 06 01:17:19.472984 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: request: GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba HTTP/1.1 Sep 06 01:17:19.472984 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept: application/json Sep 06 01:17:19.472984 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept-Encoding: identity Sep 06 01:17:19.472984 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Connection: close Sep 06 01:17:19.472984 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Length: 0 Sep 06 01:17:19.472984 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Type: application/json Sep 06 01:17:19.472984 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Host: 10.222.0.23 Sep 06 01:17:19.472984 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Openstack-System-Scope: None Sep 06 01:17:19.472984 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: User-Agent: python-urllib3/1.26.12 Sep 06 01:17:19.472984 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Auth-Token: gAAAAABjFp6ScmWDY6l7TPFx_-ileNNzy-0TIvlQgL1o_EzXzNOdniRzn-Q3l_uLSFf7uv6gmkkLfBpFrrQPrRiOoZd0XJLC1l439UYTTcF-PMxKM89jtzOq5RKgPdvEksMIjlekHUzKLmQj2uw0iewtZ-i1W_EHF7V8nHnuSbe2RR5Koil9CFE Sep 06 01:17:19.472984 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Id: None Sep 06 01:17:19.472984 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Name: None Sep 06 01:17:19.472984 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Identity-Status: Confirmed Sep 06 01:17:19.472984 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Is-Admin-Project: True Sep 06 01:17:19.472984 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Id: default Sep 06 01:17:19.472984 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Name: Default Sep 06 01:17:19.472984 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Id: 80cfec738cab491ba413e062b5a00813 Sep 06 01:17:19.472984 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Name: tempest-AttachVolumeTestJSON-1010990594 Sep 06 01:17:19.472984 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Role: reader,member Sep 06 01:17:19.472984 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Roles: reader,member Sep 06 01:17:19.474306 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/80cfec738cab491ba413e062b5a00813"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/80cfec738cab491ba413e062b5a00813"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_80cfec738cab491ba413e062b5a00813"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/80cfec738cab491ba413e062b5a00813"}]}] Sep 06 01:17:19.474306 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant: tempest-AttachVolumeTestJSON-1010990594 Sep 06 01:17:19.474306 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Id: 80cfec738cab491ba413e062b5a00813 Sep 06 01:17:19.474306 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1010990594 Sep 06 01:17:19.474306 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User: tempest-AttachVolumeTestJSON-1010990594-project Sep 06 01:17:19.474306 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Id: default Sep 06 01:17:19.474306 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Name: Default Sep 06 01:17:19.474306 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Id: e17a4e664b2c4ac9a9fea65287faad95 Sep 06 01:17:19.474306 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Name: tempest-AttachVolumeTestJSON-1010990594-project Sep 06 01:17:19.474306 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: method: > Sep 06 01:17:19.474306 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: exception: Instance c116182e-e47e-4655-a30d-5f8d52772fba could not be found. Sep 06 01:17:19.474306 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: action_args: {'id': 'c116182e-e47e-4655-a30d-5f8d52772fba'} Sep 06 01:17:19.475596 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:17:19.475596 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:17:19.475596 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 01:17:19.475596 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 01:17:19.475596 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 01:17:19.475596 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 01:17:19.475596 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 01:17:19.475596 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 01:17:19.475596 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 01:17:19.475596 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 01:17:19.475596 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c116182e-e47e-4655-a30d-5f8d52772fba could not be found. Sep 06 01:17:19.475596 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:17:19.475596 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:17:19.475596 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:17:19.475596 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:17:19.475596 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:17:19.475596 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:17:19.475596 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:17:19.475596 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:17:19.475596 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:17:19.476792 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:17:19.476792 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 01:17:19.476792 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 01:17:19.476792 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 01:17:19.476792 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 01:17:19.476792 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 01:17:19.476792 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:17:19.476792 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c116182e-e47e-4655-a30d-5f8d52772fba could not be found. Sep 06 01:17:19.476792 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:17:19.476792 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:17:19.476792 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:17:19.476792 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:17:19.476792 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:17:19.476792 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:17:19.476792 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:17:19.476792 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:17:19.476792 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c116182e-e47e-4655-a30d-5f8d52772fba could not be found. Sep 06 01:17:19.476792 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:17:19.480379 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-5e7baaa6-864b-4bd9-b131-180bf712d652 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Returning 404 to user: Instance c116182e-e47e-4655-a30d-5f8d52772fba could not be found. {{(pid=120580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:17:19.481434 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-5e7baaa6-864b-4bd9-b131-180bf712d652 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 404 len: 111 microversion: 2.1 time: 0.042949 Sep 06 01:17:19.481997 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 442/859] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:19 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 01:17:19.490993 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-10b140bd-b2ef-4c48-ba3c-0a0ace9fcc5f tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '.version_select at 0x7fb06e0b9430>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:19.510302 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-10b140bd-b2ef-4c48-ba3c-0a0ace9fcc5f tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-80550387" status: 202 len: 0 microversion: 2.1 time: 0.023594 Sep 06 01:17:19.510828 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 418/860] 10.222.0.23 () {58 vars in 1215 bytes} [Tue Sep 6 01:17:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-80550387 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 01:17:19.721524 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-a8c27b2e-7eac-40f2-88ce-0079edd59254 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:19.722145 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-a8c27b2e-7eac-40f2-88ce-0079edd59254 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: 88683beb-47e8-46e9-af24-4098c50a674a] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:19.729893 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a8c27b2e-7eac-40f2-88ce-0079edd59254 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:19.730381 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a8c27b2e-7eac-40f2-88ce-0079edd59254 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:19.730817 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a8c27b2e-7eac-40f2-88ce-0079edd59254 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:19.731517 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a8c27b2e-7eac-40f2-88ce-0079edd59254 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:19.732057 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a8c27b2e-7eac-40f2-88ce-0079edd59254 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:19.732481 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a8c27b2e-7eac-40f2-88ce-0079edd59254 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:19.747302 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.wsgi [None req-a8c27b2e-7eac-40f2-88ce-0079edd59254 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] HTTP exception thrown: Instance 88683beb-47e8-46e9-af24-4098c50a674a could not be found. Sep 06 01:17:19.749151 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-a8c27b2e-7eac-40f2-88ce-0079edd59254 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Request method failure captured: Sep 06 01:17:19.749151 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: request: GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a HTTP/1.1 Sep 06 01:17:19.749151 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept: application/json Sep 06 01:17:19.749151 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept-Encoding: identity Sep 06 01:17:19.749151 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Connection: close Sep 06 01:17:19.749151 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Length: 0 Sep 06 01:17:19.749151 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Type: application/json Sep 06 01:17:19.749151 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Host: 10.222.0.23 Sep 06 01:17:19.749151 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Openstack-System-Scope: None Sep 06 01:17:19.749151 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: User-Agent: python-urllib3/1.26.12 Sep 06 01:17:19.749151 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Auth-Token: gAAAAABjFp5NMcwKuEUHo2486ufaQ1_DZDxLGpUTLrr7cY7CHRRWjkMwkS2RH-midIYAwqOB5ZPR8PbCADD5XlDFDs-1j0nZ0VMlxZ2i03OyHDj--OqiIIDDm8dNS5bEMfqSgxwbC1vfe-w2IKMjXfHxinzodZYhHEbGdxznmqwbs3qXAmEUuhE Sep 06 01:17:19.749151 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Id: None Sep 06 01:17:19.749151 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Name: None Sep 06 01:17:19.749151 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Identity-Status: Confirmed Sep 06 01:17:19.749151 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Is-Admin-Project: True Sep 06 01:17:19.749151 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Id: default Sep 06 01:17:19.749151 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Name: Default Sep 06 01:17:19.749151 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Id: 91ee5ad0b4064b9d8a038980786072cb Sep 06 01:17:19.749151 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-317724904 Sep 06 01:17:19.749151 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Role: reader,member Sep 06 01:17:19.749151 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Roles: reader,member Sep 06 01:17:19.750603 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ee5ad0b4064b9d8a038980786072cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/91ee5ad0b4064b9d8a038980786072cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_91ee5ad0b4064b9d8a038980786072cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ee5ad0b4064b9d8a038980786072cb"}]}] Sep 06 01:17:19.750603 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant: tempest-ServerRescueNegativeTestJSON-317724904 Sep 06 01:17:19.750603 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Id: 91ee5ad0b4064b9d8a038980786072cb Sep 06 01:17:19.750603 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-317724904 Sep 06 01:17:19.750603 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User: tempest-ServerRescueNegativeTestJSON-317724904-project Sep 06 01:17:19.750603 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Id: default Sep 06 01:17:19.750603 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Name: Default Sep 06 01:17:19.750603 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Id: 703464e4a9524efaa8fdfc1870158cbb Sep 06 01:17:19.750603 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Name: tempest-ServerRescueNegativeTestJSON-317724904-project Sep 06 01:17:19.750603 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: method: > Sep 06 01:17:19.750603 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: exception: Instance 88683beb-47e8-46e9-af24-4098c50a674a could not be found. Sep 06 01:17:19.750603 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: action_args: {'id': '88683beb-47e8-46e9-af24-4098c50a674a'} Sep 06 01:17:19.751491 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:17:19.751491 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:17:19.751491 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 01:17:19.751491 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 01:17:19.751491 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 01:17:19.751491 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 01:17:19.751491 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 01:17:19.751491 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 01:17:19.751491 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 01:17:19.751491 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 01:17:19.751491 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88683beb-47e8-46e9-af24-4098c50a674a could not be found. Sep 06 01:17:19.751491 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:17:19.751491 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:17:19.751491 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:17:19.751491 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:17:19.751491 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:17:19.751491 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:17:19.751491 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:17:19.751491 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:17:19.751491 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:17:19.752941 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:17:19.752941 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 01:17:19.752941 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 01:17:19.752941 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 01:17:19.752941 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 01:17:19.752941 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 01:17:19.752941 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:17:19.752941 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88683beb-47e8-46e9-af24-4098c50a674a could not be found. Sep 06 01:17:19.752941 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:17:19.752941 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:17:19.752941 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:17:19.752941 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:17:19.752941 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:17:19.752941 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:17:19.752941 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:17:19.752941 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:17:19.752941 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88683beb-47e8-46e9-af24-4098c50a674a could not be found. Sep 06 01:17:19.752941 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:17:19.754287 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-a8c27b2e-7eac-40f2-88ce-0079edd59254 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Returning 404 to user: Instance 88683beb-47e8-46e9-af24-4098c50a674a could not be found. {{(pid=120580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:17:19.754287 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-a8c27b2e-7eac-40f2-88ce-0079edd59254 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a" status: 404 len: 111 microversion: 2.1 time: 0.033783 Sep 06 01:17:19.754287 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 443/861] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:19 2022] GET /compute/v2.1/servers/88683beb-47e8-46e9-af24-4098c50a674a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 01:17:19.760813 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6a297d87-a7bf-4f4a-8a99-c9c6cff099fd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:19.761345 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6a297d87-a7bf-4f4a-8a99-c9c6cff099fd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:19.767559 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6a297d87-a7bf-4f4a-8a99-c9c6cff099fd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:19.768165 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6a297d87-a7bf-4f4a-8a99-c9c6cff099fd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:19.768674 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6a297d87-a7bf-4f4a-8a99-c9c6cff099fd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:19.769459 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6a297d87-a7bf-4f4a-8a99-c9c6cff099fd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:19.770721 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6a297d87-a7bf-4f4a-8a99-c9c6cff099fd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:19.771713 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6a297d87-a7bf-4f4a-8a99-c9c6cff099fd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:19.798396 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6a297d87-a7bf-4f4a-8a99-c9c6cff099fd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 01:17:19.802778 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-01545907-377c-43bd-bba7-5d7204dd227e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:19.803394 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-01545907-377c-43bd-bba7-5d7204dd227e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:19.809895 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-01545907-377c-43bd-bba7-5d7204dd227e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:19.811026 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-01545907-377c-43bd-bba7-5d7204dd227e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:19.811466 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-01545907-377c-43bd-bba7-5d7204dd227e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:19.812191 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-01545907-377c-43bd-bba7-5d7204dd227e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:19.812810 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-01545907-377c-43bd-bba7-5d7204dd227e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:19.813242 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-01545907-377c-43bd-bba7-5d7204dd227e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:19.825199 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:17:19.880942 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6a297d87-a7bf-4f4a-8a99-c9c6cff099fd tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 204 len: 0 microversion: 2.1 time: 0.124246 Sep 06 01:17:19.881908 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 419/862] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 6 01:17:19 2022] DELETE /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 01:17:19.890339 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-579d4957-f805-437c-acf4-452fa9691e58 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:19.891032 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-579d4957-f805-437c-acf4-452fa9691e58 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:19.897274 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-579d4957-f805-437c-acf4-452fa9691e58 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:19.897752 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-579d4957-f805-437c-acf4-452fa9691e58 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:19.898181 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-579d4957-f805-437c-acf4-452fa9691e58 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:19.899095 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-579d4957-f805-437c-acf4-452fa9691e58 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:19.899309 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-579d4957-f805-437c-acf4-452fa9691e58 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:19.899727 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-579d4957-f805-437c-acf4-452fa9691e58 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:20.098463 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-01545907-377c-43bd-bba7-5d7204dd227e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:20.107391 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-01545907-377c-43bd-bba7-5d7204dd227e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:20.108873 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-01545907-377c-43bd-bba7-5d7204dd227e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:20.110064 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-01545907-377c-43bd-bba7-5d7204dd227e tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1724 microversion: 2.20 time: 0.311438 Sep 06 01:17:20.110625 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 444/863] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:17:19 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1724 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:17:20.139667 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-579d4957-f805-437c-acf4-452fa9691e58 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:20.148106 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-579d4957-f805-437c-acf4-452fa9691e58 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1520 microversion: 2.1 time: 0.261660 Sep 06 01:17:20.149144 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 420/864] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:19 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1520 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:17:20.180262 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-bcc062d1-4501-4000-a07f-3e45a961deb6 req-15380380-2078-4543-8f0c-8248548d99ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c116182e-e47e-4655-a30d-5f8d52772fba", "name": "network-vif-deleted", "tag": "c1420767-f22f-45e4-9e34-63a18969b34d"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:17:20.190009 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-bcc062d1-4501-4000-a07f-3e45a961deb6 req-15380380-2078-4543-8f0c-8248548d99ad service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:20.190492 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-bcc062d1-4501-4000-a07f-3e45a961deb6 req-15380380-2078-4543-8f0c-8248548d99ad service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:20.190923 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-bcc062d1-4501-4000-a07f-3e45a961deb6 req-15380380-2078-4543-8f0c-8248548d99ad service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:20.203620 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.compute.server_external_events [req-bcc062d1-4501-4000-a07f-3e45a961deb6 req-15380380-2078-4543-8f0c-8248548d99ad service nova] Creating event network-vif-deleted:c1420767-f22f-45e4-9e34-63a18969b34d for instance c116182e-e47e-4655-a30d-5f8d52772fba on hv-cinder-84773 Sep 06 01:17:20.208544 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [req-bcc062d1-4501-4000-a07f-3e45a961deb6 req-15380380-2078-4543-8f0c-8248548d99ad service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032078 Sep 06 01:17:20.209698 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 445/865] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:17:20.315374 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8b0b64bc-2da6-47f6-8efa-5c7324b3b2a1 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Action: 'create', calling method: .version_select at 0x7fb06e03e160>, body: {"keypair": {"name": "tempest-keypair-1079460770", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNvoKKq+WjM0Z1Cb41dBmVpjAgUNOvivtXMF6kgZsUQyGJCBrwHohM5QJOvHH4oWL6h9uyqvmmCFL8H4CPhbdlfgXI0YTC1hUkyadiY1iJ0qAvih10SUaFe0MCLQEyY5Zg=="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:17:20.325847 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:17:20.332320 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.quota [None req-8b0b64bc-2da6-47f6-8efa-5c7324b3b2a1 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Getting quotas for project 80cfec738cab491ba413e062b5a00813. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 01:17:20.337199 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.quota [None req-8b0b64bc-2da6-47f6-8efa-5c7324b3b2a1 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Getting quotas for user e17a4e664b2c4ac9a9fea65287faad95 and project 80cfec738cab491ba413e062b5a00813. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 01:17:20.360257 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8b0b64bc-2da6-47f6-8efa-5c7324b3b2a1 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048849 Sep 06 01:17:20.360849 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 421/866] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Sep 6 01:17:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:17:21.136227 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-dfdea2d8-a40f-4216-9241-6b47bb0d0025 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:21.136924 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-dfdea2d8-a40f-4216-9241-6b47bb0d0025 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:21.142902 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dfdea2d8-a40f-4216-9241-6b47bb0d0025 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:21.143383 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dfdea2d8-a40f-4216-9241-6b47bb0d0025 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:21.143836 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dfdea2d8-a40f-4216-9241-6b47bb0d0025 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:21.144523 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dfdea2d8-a40f-4216-9241-6b47bb0d0025 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:21.144996 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dfdea2d8-a40f-4216-9241-6b47bb0d0025 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:21.145586 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dfdea2d8-a40f-4216-9241-6b47bb0d0025 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:21.149664 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:17:21.172174 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9b7c115d-5362-48e2-9a8e-2c5acb98635c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:21.173510 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9b7c115d-5362-48e2-9a8e-2c5acb98635c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:21.187675 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b7c115d-5362-48e2-9a8e-2c5acb98635c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:21.188191 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b7c115d-5362-48e2-9a8e-2c5acb98635c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:21.188629 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b7c115d-5362-48e2-9a8e-2c5acb98635c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:21.189328 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b7c115d-5362-48e2-9a8e-2c5acb98635c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:21.189783 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b7c115d-5362-48e2-9a8e-2c5acb98635c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:21.190206 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b7c115d-5362-48e2-9a8e-2c5acb98635c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:21.433298 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-dfdea2d8-a40f-4216-9241-6b47bb0d0025 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:21.441882 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-dfdea2d8-a40f-4216-9241-6b47bb0d0025 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:21.443317 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-dfdea2d8-a40f-4216-9241-6b47bb0d0025 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:21.444514 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-dfdea2d8-a40f-4216-9241-6b47bb0d0025 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1724 microversion: 2.20 time: 0.313788 Sep 06 01:17:21.445064 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 446/867] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:17:21 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1724 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:17:21.447437 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-9b7c115d-5362-48e2-9a8e-2c5acb98635c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:21.455342 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9b7c115d-5362-48e2-9a8e-2c5acb98635c tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1520 microversion: 2.1 time: 0.288065 Sep 06 01:17:21.456005 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 422/868] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:21 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1520 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:17:21.789040 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-105a1a1f-91c4-4c3c-bf93-7dc9ec5193a3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-398666080", "imageRef": "768973cc-7b5f-4eed-b493-e40eb0de9f88", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dcf25d1c-5a22-43e5-ace0-2f3939ca0a91"}], "security_groups": [{"name": "tempest-securitygroup--93059913"}], "key_name": "tempest-keypair-1079460770", "user_data": "}} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:17:21.891117 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.network.neutron [None req-105a1a1f-91c4-4c3c-bf93-7dc9ec5193a3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] validate_networks() for [('dcf25d1c-5a22-43e5-ace0-2f3939ca0a91', None, None, None, None, None)] {{(pid=120580) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 01:17:22.306832 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-105a1a1f-91c4-4c3c-bf93-7dc9ec5193a3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Flavor limits 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 01:17:22.307439 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-105a1a1f-91c4-4c3c-bf93-7dc9ec5193a3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Image limits 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 01:17:22.307727 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-105a1a1f-91c4-4c3c-bf93-7dc9ec5193a3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Flavor pref 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 01:17:22.308174 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-105a1a1f-91c4-4c3c-bf93-7dc9ec5193a3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Image pref 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 01:17:22.308592 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-105a1a1f-91c4-4c3c-bf93-7dc9ec5193a3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 01:17:22.317309 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-105a1a1f-91c4-4c3c-bf93-7dc9ec5193a3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:22.317793 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-105a1a1f-91c4-4c3c-bf93-7dc9ec5193a3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:22.318285 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-105a1a1f-91c4-4c3c-bf93-7dc9ec5193a3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:22.319014 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-105a1a1f-91c4-4c3c-bf93-7dc9ec5193a3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:22.319473 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-105a1a1f-91c4-4c3c-bf93-7dc9ec5193a3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:22.319928 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-105a1a1f-91c4-4c3c-bf93-7dc9ec5193a3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:22.336458 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.quota [None req-105a1a1f-91c4-4c3c-bf93-7dc9ec5193a3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Getting quotas for project 80cfec738cab491ba413e062b5a00813. Resources: {'instances', 'ram', 'cores'} {{(pid=120580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 01:17:22.340431 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.quota [None req-105a1a1f-91c4-4c3c-bf93-7dc9ec5193a3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Getting quotas for user e17a4e664b2c4ac9a9fea65287faad95 and project 80cfec738cab491ba413e062b5a00813. Resources: {'instances', 'ram', 'cores'} {{(pid=120580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 01:17:22.352070 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-105a1a1f-91c4-4c3c-bf93-7dc9ec5193a3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Going to run 1 instances... {{(pid=120580) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 01:17:22.354404 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-105a1a1f-91c4-4c3c-bf93-7dc9ec5193a3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: 1a77e639-92e6-4c82-888f-423ae3a0d290] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='768973cc-7b5f-4eed-b493-e40eb0de9f88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 01:17:22.402512 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-105a1a1f-91c4-4c3c-bf93-7dc9ec5193a3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.617761 Sep 06 01:17:22.403372 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 447/869] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Sep 6 01:17:21 2022] POST /compute/v2.1/servers => generated 400 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 01:17:22.414970 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1b650a52-0051-45ed-bf76-db7719462a14 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:22.416189 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1b650a52-0051-45ed-bf76-db7719462a14 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: 1a77e639-92e6-4c82-888f-423ae3a0d290] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:22.471444 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-412d5edc-0697-44c2-8b64-1be42c4a905a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:22.472011 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-412d5edc-0697-44c2-8b64-1be42c4a905a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:22.480012 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-412d5edc-0697-44c2-8b64-1be42c4a905a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:22.480747 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-412d5edc-0697-44c2-8b64-1be42c4a905a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:22.481384 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-1b650a52-0051-45ed-bf76-db7719462a14 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:22.482302 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-412d5edc-0697-44c2-8b64-1be42c4a905a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:22.484407 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-412d5edc-0697-44c2-8b64-1be42c4a905a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:22.485053 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-412d5edc-0697-44c2-8b64-1be42c4a905a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:22.485672 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-412d5edc-0697-44c2-8b64-1be42c4a905a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:22.494740 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1b650a52-0051-45ed-bf76-db7719462a14 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290" status: 200 len: 1237 microversion: 2.1 time: 0.083556 Sep 06 01:17:22.495624 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 423/870] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:22 2022] GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290 => generated 1237 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:17:22.515023 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2e5bb7de-5b71-422b-af94-17ca243aabda tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:22.516002 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2e5bb7de-5b71-422b-af94-17ca243aabda tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:22.533839 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e5bb7de-5b71-422b-af94-17ca243aabda tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:22.534345 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e5bb7de-5b71-422b-af94-17ca243aabda tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:22.534790 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e5bb7de-5b71-422b-af94-17ca243aabda tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:22.535504 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e5bb7de-5b71-422b-af94-17ca243aabda tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:22.535992 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e5bb7de-5b71-422b-af94-17ca243aabda tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:22.542688 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e5bb7de-5b71-422b-af94-17ca243aabda tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:22.644251 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-2e5bb7de-5b71-422b-af94-17ca243aabda tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703464e4a9524efaa8fdfc1870158cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee5ad0b4064b9d8a038980786072cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:22.657531 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2e5bb7de-5b71-422b-af94-17ca243aabda tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 200 len: 1478 microversion: 2.1 time: 0.148557 Sep 06 01:17:22.658485 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 424/871] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:22 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 1478 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:17:22.700451 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-7803ac02-86e5-4892-a70b-dad38cd5dbac req-45f41845-2164-49e2-8f8e-800434a1d546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf424d2a-0a95-48dc-9ee5-13fab569cb43", "name": "network-vif-deleted", "tag": "c4540d59-8bd2-4cb6-a994-d575e41892b8"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:17:22.714836 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-7803ac02-86e5-4892-a70b-dad38cd5dbac req-45f41845-2164-49e2-8f8e-800434a1d546 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:22.715878 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-7803ac02-86e5-4892-a70b-dad38cd5dbac req-45f41845-2164-49e2-8f8e-800434a1d546 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:22.716341 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-7803ac02-86e5-4892-a70b-dad38cd5dbac req-45f41845-2164-49e2-8f8e-800434a1d546 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:22.726099 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-412d5edc-0697-44c2-8b64-1be42c4a905a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:22.728656 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-7803ac02-86e5-4892-a70b-dad38cd5dbac req-45f41845-2164-49e2-8f8e-800434a1d546 service nova] Creating event network-vif-deleted:c4540d59-8bd2-4cb6-a994-d575e41892b8 for instance cf424d2a-0a95-48dc-9ee5-13fab569cb43 on hv-cinder-84773 Sep 06 01:17:22.733549 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-7803ac02-86e5-4892-a70b-dad38cd5dbac req-45f41845-2164-49e2-8f8e-800434a1d546 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041860 Sep 06 01:17:22.734470 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 425/872] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:17:22.741750 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-412d5edc-0697-44c2-8b64-1be42c4a905a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:22.743216 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-412d5edc-0697-44c2-8b64-1be42c4a905a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:22.744442 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-412d5edc-0697-44c2-8b64-1be42c4a905a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1724 microversion: 2.20 time: 0.277531 Sep 06 01:17:22.745203 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 448/873] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:17:22 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1724 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:17:23.517619 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1e85c6c8-601b-45a7-bfc7-5bfc808bea3d tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:23.518248 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1e85c6c8-601b-45a7-bfc7-5bfc808bea3d tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: 1a77e639-92e6-4c82-888f-423ae3a0d290] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:23.524326 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e85c6c8-601b-45a7-bfc7-5bfc808bea3d tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:23.524802 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e85c6c8-601b-45a7-bfc7-5bfc808bea3d tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:23.525229 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e85c6c8-601b-45a7-bfc7-5bfc808bea3d tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:23.525903 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e85c6c8-601b-45a7-bfc7-5bfc808bea3d tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:23.526350 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e85c6c8-601b-45a7-bfc7-5bfc808bea3d tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:23.526771 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e85c6c8-601b-45a7-bfc7-5bfc808bea3d tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:23.588429 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-1e85c6c8-601b-45a7-bfc7-5bfc808bea3d tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:23.596227 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1e85c6c8-601b-45a7-bfc7-5bfc808bea3d tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290" status: 200 len: 1289 microversion: 2.1 time: 0.082883 Sep 06 01:17:23.596775 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 426/874] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:23 2022] GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290 => generated 1289 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:17:23.683862 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-19006fd2-5c6e-487b-ab35-d71b212f6af6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:23.684484 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-19006fd2-5c6e-487b-ab35-d71b212f6af6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] [instance: cf424d2a-0a95-48dc-9ee5-13fab569cb43] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:23.690938 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-19006fd2-5c6e-487b-ab35-d71b212f6af6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:23.691424 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-19006fd2-5c6e-487b-ab35-d71b212f6af6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:23.691888 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-19006fd2-5c6e-487b-ab35-d71b212f6af6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:23.692584 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-19006fd2-5c6e-487b-ab35-d71b212f6af6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:23.693104 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-19006fd2-5c6e-487b-ab35-d71b212f6af6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:23.693538 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-19006fd2-5c6e-487b-ab35-d71b212f6af6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:23.706618 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.wsgi [None req-19006fd2-5c6e-487b-ab35-d71b212f6af6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] HTTP exception thrown: Instance cf424d2a-0a95-48dc-9ee5-13fab569cb43 could not be found. Sep 06 01:17:23.708386 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-19006fd2-5c6e-487b-ab35-d71b212f6af6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Request method failure captured: Sep 06 01:17:23.708386 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: request: GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 HTTP/1.1 Sep 06 01:17:23.708386 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept: application/json Sep 06 01:17:23.708386 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept-Encoding: identity Sep 06 01:17:23.708386 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Connection: close Sep 06 01:17:23.708386 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Length: 0 Sep 06 01:17:23.708386 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Type: application/json Sep 06 01:17:23.708386 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Host: 10.222.0.23 Sep 06 01:17:23.708386 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Openstack-System-Scope: None Sep 06 01:17:23.708386 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: User-Agent: python-urllib3/1.26.12 Sep 06 01:17:23.708386 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Auth-Token: gAAAAABjFp5NMcwKuEUHo2486ufaQ1_DZDxLGpUTLrr7cY7CHRRWjkMwkS2RH-midIYAwqOB5ZPR8PbCADD5XlDFDs-1j0nZ0VMlxZ2i03OyHDj--OqiIIDDm8dNS5bEMfqSgxwbC1vfe-w2IKMjXfHxinzodZYhHEbGdxznmqwbs3qXAmEUuhE Sep 06 01:17:23.708386 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Id: None Sep 06 01:17:23.708386 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Name: None Sep 06 01:17:23.708386 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Identity-Status: Confirmed Sep 06 01:17:23.708386 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Is-Admin-Project: True Sep 06 01:17:23.708386 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Id: default Sep 06 01:17:23.708386 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Name: Default Sep 06 01:17:23.708386 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Id: 91ee5ad0b4064b9d8a038980786072cb Sep 06 01:17:23.708386 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-317724904 Sep 06 01:17:23.708386 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Role: reader,member Sep 06 01:17:23.708386 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Roles: reader,member Sep 06 01:17:23.709935 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ee5ad0b4064b9d8a038980786072cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/91ee5ad0b4064b9d8a038980786072cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_91ee5ad0b4064b9d8a038980786072cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ee5ad0b4064b9d8a038980786072cb"}]}] Sep 06 01:17:23.709935 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant: tempest-ServerRescueNegativeTestJSON-317724904 Sep 06 01:17:23.709935 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Id: 91ee5ad0b4064b9d8a038980786072cb Sep 06 01:17:23.709935 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-317724904 Sep 06 01:17:23.709935 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User: tempest-ServerRescueNegativeTestJSON-317724904-project Sep 06 01:17:23.709935 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Id: default Sep 06 01:17:23.709935 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Name: Default Sep 06 01:17:23.709935 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Id: 703464e4a9524efaa8fdfc1870158cbb Sep 06 01:17:23.709935 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Name: tempest-ServerRescueNegativeTestJSON-317724904-project Sep 06 01:17:23.709935 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: method: > Sep 06 01:17:23.709935 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: exception: Instance cf424d2a-0a95-48dc-9ee5-13fab569cb43 could not be found. Sep 06 01:17:23.709935 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: action_args: {'id': 'cf424d2a-0a95-48dc-9ee5-13fab569cb43'} Sep 06 01:17:23.710784 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:17:23.710784 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:17:23.710784 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 01:17:23.710784 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 01:17:23.710784 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 01:17:23.710784 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 01:17:23.710784 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 01:17:23.710784 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 01:17:23.710784 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 01:17:23.710784 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 01:17:23.710784 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf424d2a-0a95-48dc-9ee5-13fab569cb43 could not be found. Sep 06 01:17:23.710784 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:17:23.710784 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:17:23.710784 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:17:23.710784 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:17:23.710784 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:17:23.710784 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:17:23.710784 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:17:23.710784 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:17:23.710784 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:17:23.712300 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:17:23.712300 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 01:17:23.712300 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 01:17:23.712300 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 01:17:23.712300 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 01:17:23.712300 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 01:17:23.712300 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:17:23.712300 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf424d2a-0a95-48dc-9ee5-13fab569cb43 could not be found. Sep 06 01:17:23.712300 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:17:23.712300 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:17:23.712300 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:17:23.712300 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:17:23.712300 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:17:23.712300 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:17:23.712300 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:17:23.712300 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:17:23.712300 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf424d2a-0a95-48dc-9ee5-13fab569cb43 could not be found. Sep 06 01:17:23.712300 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:17:23.713638 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-19006fd2-5c6e-487b-ab35-d71b212f6af6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] Returning 404 to user: Instance cf424d2a-0a95-48dc-9ee5-13fab569cb43 could not be found. {{(pid=120580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:17:23.713638 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-19006fd2-5c6e-487b-ab35-d71b212f6af6 tempest-ServerRescueNegativeTestJSON-317724904 tempest-ServerRescueNegativeTestJSON-317724904-project] 10.222.0.23 "GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43" status: 404 len: 111 microversion: 2.1 time: 0.029893 Sep 06 01:17:23.713638 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 449/875] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:23 2022] GET /compute/v2.1/servers/cf424d2a-0a95-48dc-9ee5-13fab569cb43 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 01:17:23.770841 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-95761d43-b458-4402-8394-a3ee96c41be6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:23.771704 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-95761d43-b458-4402-8394-a3ee96c41be6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:23.778220 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95761d43-b458-4402-8394-a3ee96c41be6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:23.778914 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95761d43-b458-4402-8394-a3ee96c41be6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:23.779667 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95761d43-b458-4402-8394-a3ee96c41be6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:23.780550 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95761d43-b458-4402-8394-a3ee96c41be6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:23.781226 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95761d43-b458-4402-8394-a3ee96c41be6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:23.781652 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95761d43-b458-4402-8394-a3ee96c41be6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:23.934934 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-95761d43-b458-4402-8394-a3ee96c41be6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:23.944452 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-95761d43-b458-4402-8394-a3ee96c41be6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:23.946055 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-95761d43-b458-4402-8394-a3ee96c41be6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:23.947252 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-95761d43-b458-4402-8394-a3ee96c41be6 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1724 microversion: 2.20 time: 0.180583 Sep 06 01:17:23.947842 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 427/876] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:17:23 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:17:24.618935 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-ea312455-0931-4714-abd0-69f10d72b5d8 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:24.619543 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-ea312455-0931-4714-abd0-69f10d72b5d8 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: 1a77e639-92e6-4c82-888f-423ae3a0d290] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:24.625408 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ea312455-0931-4714-abd0-69f10d72b5d8 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:24.626284 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ea312455-0931-4714-abd0-69f10d72b5d8 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:24.626730 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ea312455-0931-4714-abd0-69f10d72b5d8 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:24.627426 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ea312455-0931-4714-abd0-69f10d72b5d8 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:24.627903 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ea312455-0931-4714-abd0-69f10d72b5d8 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:24.628328 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ea312455-0931-4714-abd0-69f10d72b5d8 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:24.693030 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-ea312455-0931-4714-abd0-69f10d72b5d8 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:24.701402 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-ea312455-0931-4714-abd0-69f10d72b5d8 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290" status: 200 len: 1295 microversion: 2.1 time: 0.086658 Sep 06 01:17:24.701964 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 450/877] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:24 2022] GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290 => generated 1295 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:17:24.973183 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7a7dffdb-eb8e-4b3e-a868-67538bc53cd3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:24.973835 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7a7dffdb-eb8e-4b3e-a868-67538bc53cd3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:24.980235 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a7dffdb-eb8e-4b3e-a868-67538bc53cd3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:24.980720 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a7dffdb-eb8e-4b3e-a868-67538bc53cd3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:24.981149 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a7dffdb-eb8e-4b3e-a868-67538bc53cd3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:24.981833 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a7dffdb-eb8e-4b3e-a868-67538bc53cd3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:24.982278 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a7dffdb-eb8e-4b3e-a868-67538bc53cd3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:24.982695 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a7dffdb-eb8e-4b3e-a868-67538bc53cd3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:25.111410 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-7a7dffdb-eb8e-4b3e-a868-67538bc53cd3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:25.120463 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-7a7dffdb-eb8e-4b3e-a868-67538bc53cd3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:25.122098 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-7a7dffdb-eb8e-4b3e-a868-67538bc53cd3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:25.123271 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7a7dffdb-eb8e-4b3e-a868-67538bc53cd3 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1724 microversion: 2.20 time: 0.154068 Sep 06 01:17:25.123857 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 428/878] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:17:24 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:17:25.724802 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-0afa6236-7463-4827-80c1-36e7ee0b8646 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:25.725424 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-0afa6236-7463-4827-80c1-36e7ee0b8646 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: 1a77e639-92e6-4c82-888f-423ae3a0d290] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:25.731900 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0afa6236-7463-4827-80c1-36e7ee0b8646 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:25.732395 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0afa6236-7463-4827-80c1-36e7ee0b8646 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:25.732833 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0afa6236-7463-4827-80c1-36e7ee0b8646 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:25.733538 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0afa6236-7463-4827-80c1-36e7ee0b8646 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:25.734255 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0afa6236-7463-4827-80c1-36e7ee0b8646 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:25.734756 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0afa6236-7463-4827-80c1-36e7ee0b8646 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:25.874498 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-0afa6236-7463-4827-80c1-36e7ee0b8646 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:25.882812 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-0afa6236-7463-4827-80c1-36e7ee0b8646 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290" status: 200 len: 1361 microversion: 2.1 time: 0.161841 Sep 06 01:17:25.892267 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 451/879] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:25 2022] GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290 => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:17:26.149165 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-91151d9a-b7f6-4baa-aa6a-90cec6f9152b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:26.149928 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-91151d9a-b7f6-4baa-aa6a-90cec6f9152b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:26.156441 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91151d9a-b7f6-4baa-aa6a-90cec6f9152b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:26.156928 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91151d9a-b7f6-4baa-aa6a-90cec6f9152b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:26.157367 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91151d9a-b7f6-4baa-aa6a-90cec6f9152b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:26.158058 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91151d9a-b7f6-4baa-aa6a-90cec6f9152b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:26.158514 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91151d9a-b7f6-4baa-aa6a-90cec6f9152b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:26.158938 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91151d9a-b7f6-4baa-aa6a-90cec6f9152b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:26.294224 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-91151d9a-b7f6-4baa-aa6a-90cec6f9152b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:26.302511 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-91151d9a-b7f6-4baa-aa6a-90cec6f9152b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:26.304026 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-91151d9a-b7f6-4baa-aa6a-90cec6f9152b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:26.305187 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-91151d9a-b7f6-4baa-aa6a-90cec6f9152b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1724 microversion: 2.20 time: 0.160069 Sep 06 01:17:26.305746 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 429/880] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:17:26 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:17:26.722671 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-adaf116b-2b86-4c66-af4b-d922e9a14565 req-7ba92415-f5e3-4ad5-9ed4-5953a1dfee31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a77e639-92e6-4c82-888f-423ae3a0d290", "tag": "7e16664d-c221-4c8e-9a39-00aed6e29f44"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:17:26.738930 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-adaf116b-2b86-4c66-af4b-d922e9a14565 req-7ba92415-f5e3-4ad5-9ed4-5953a1dfee31 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:26.740572 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-adaf116b-2b86-4c66-af4b-d922e9a14565 req-7ba92415-f5e3-4ad5-9ed4-5953a1dfee31 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:26.742045 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-adaf116b-2b86-4c66-af4b-d922e9a14565 req-7ba92415-f5e3-4ad5-9ed4-5953a1dfee31 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:26.763616 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.compute.server_external_events [req-adaf116b-2b86-4c66-af4b-d922e9a14565 req-7ba92415-f5e3-4ad5-9ed4-5953a1dfee31 service nova] Creating event network-changed:7e16664d-c221-4c8e-9a39-00aed6e29f44 for instance 1a77e639-92e6-4c82-888f-423ae3a0d290 on hv-cinder-84773 Sep 06 01:17:26.769922 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [req-adaf116b-2b86-4c66-af4b-d922e9a14565 req-7ba92415-f5e3-4ad5-9ed4-5953a1dfee31 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053550 Sep 06 01:17:26.771296 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 452/881] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:17:26.906068 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e1274e5c-efd0-4fe3-b38f-f654afa562e3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:26.907031 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e1274e5c-efd0-4fe3-b38f-f654afa562e3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: 1a77e639-92e6-4c82-888f-423ae3a0d290] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:26.913433 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1274e5c-efd0-4fe3-b38f-f654afa562e3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:26.914198 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1274e5c-efd0-4fe3-b38f-f654afa562e3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:26.914794 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1274e5c-efd0-4fe3-b38f-f654afa562e3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:26.916477 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1274e5c-efd0-4fe3-b38f-f654afa562e3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:26.917163 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1274e5c-efd0-4fe3-b38f-f654afa562e3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:26.917597 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1274e5c-efd0-4fe3-b38f-f654afa562e3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:27.078989 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-e1274e5c-efd0-4fe3-b38f-f654afa562e3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:27.087096 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e1274e5c-efd0-4fe3-b38f-f654afa562e3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290" status: 200 len: 1361 microversion: 2.1 time: 0.185503 Sep 06 01:17:27.087876 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 430/882] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:26 2022] GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290 => generated 1361 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:17:27.331016 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-4051c5cf-0c2c-4cd5-8d5f-370a7f3b625d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:27.331709 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-4051c5cf-0c2c-4cd5-8d5f-370a7f3b625d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:27.338311 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4051c5cf-0c2c-4cd5-8d5f-370a7f3b625d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:27.338794 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4051c5cf-0c2c-4cd5-8d5f-370a7f3b625d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:27.339224 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4051c5cf-0c2c-4cd5-8d5f-370a7f3b625d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:27.339943 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4051c5cf-0c2c-4cd5-8d5f-370a7f3b625d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:27.340394 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4051c5cf-0c2c-4cd5-8d5f-370a7f3b625d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:27.340817 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4051c5cf-0c2c-4cd5-8d5f-370a7f3b625d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:27.471738 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-4051c5cf-0c2c-4cd5-8d5f-370a7f3b625d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:27.481058 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-4051c5cf-0c2c-4cd5-8d5f-370a7f3b625d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:27.482560 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-4051c5cf-0c2c-4cd5-8d5f-370a7f3b625d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:27.483813 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-4051c5cf-0c2c-4cd5-8d5f-370a7f3b625d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1724 microversion: 2.20 time: 0.157024 Sep 06 01:17:27.484329 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 453/883] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:17:27 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:17:28.109890 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d3a9296e-7ae5-4e24-8cb1-6ccfaf6ed719 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:28.110637 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d3a9296e-7ae5-4e24-8cb1-6ccfaf6ed719 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: 1a77e639-92e6-4c82-888f-423ae3a0d290] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:28.117214 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d3a9296e-7ae5-4e24-8cb1-6ccfaf6ed719 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:28.117784 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d3a9296e-7ae5-4e24-8cb1-6ccfaf6ed719 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:28.118599 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d3a9296e-7ae5-4e24-8cb1-6ccfaf6ed719 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:28.119388 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d3a9296e-7ae5-4e24-8cb1-6ccfaf6ed719 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:28.119955 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d3a9296e-7ae5-4e24-8cb1-6ccfaf6ed719 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:28.120454 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d3a9296e-7ae5-4e24-8cb1-6ccfaf6ed719 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:28.266823 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-d3a9296e-7ae5-4e24-8cb1-6ccfaf6ed719 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:28.275662 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d3a9296e-7ae5-4e24-8cb1-6ccfaf6ed719 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290" status: 200 len: 1361 microversion: 2.1 time: 0.169782 Sep 06 01:17:28.284271 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 431/884] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:28 2022] GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290 => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:17:28.517305 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-2fc9897f-aa44-4dba-9039-1e346d15567a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:28.518055 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-2fc9897f-aa44-4dba-9039-1e346d15567a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:28.528764 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2fc9897f-aa44-4dba-9039-1e346d15567a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:28.529366 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2fc9897f-aa44-4dba-9039-1e346d15567a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:28.530069 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2fc9897f-aa44-4dba-9039-1e346d15567a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:28.531529 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2fc9897f-aa44-4dba-9039-1e346d15567a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:28.532529 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2fc9897f-aa44-4dba-9039-1e346d15567a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:28.533842 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2fc9897f-aa44-4dba-9039-1e346d15567a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:28.812673 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-2fc9897f-aa44-4dba-9039-1e346d15567a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:28.822460 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-2fc9897f-aa44-4dba-9039-1e346d15567a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:28.825454 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-2fc9897f-aa44-4dba-9039-1e346d15567a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:28.827234 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-2fc9897f-aa44-4dba-9039-1e346d15567a tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1724 microversion: 2.20 time: 0.318330 Sep 06 01:17:28.828332 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 454/885] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:17:28 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1724 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:17:29.298998 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-48a7e9fd-b445-4f80-a1d3-242fa63fce22 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:29.299720 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-48a7e9fd-b445-4f80-a1d3-242fa63fce22 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: 1a77e639-92e6-4c82-888f-423ae3a0d290] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:29.306057 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48a7e9fd-b445-4f80-a1d3-242fa63fce22 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:29.306543 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48a7e9fd-b445-4f80-a1d3-242fa63fce22 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:29.306979 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48a7e9fd-b445-4f80-a1d3-242fa63fce22 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:29.307667 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48a7e9fd-b445-4f80-a1d3-242fa63fce22 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:29.308144 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48a7e9fd-b445-4f80-a1d3-242fa63fce22 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:29.308567 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48a7e9fd-b445-4f80-a1d3-242fa63fce22 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:29.440532 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-48a7e9fd-b445-4f80-a1d3-242fa63fce22 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:29.448163 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-48a7e9fd-b445-4f80-a1d3-242fa63fce22 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290" status: 200 len: 1361 microversion: 2.1 time: 0.153078 Sep 06 01:17:29.448879 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 432/886] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:29 2022] GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:17:29.855701 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-70248295-dafe-4251-81f9-a30eafde0c89 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:29.856587 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-70248295-dafe-4251-81f9-a30eafde0c89 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:29.863677 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-70248295-dafe-4251-81f9-a30eafde0c89 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:29.864211 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-70248295-dafe-4251-81f9-a30eafde0c89 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:29.864644 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-70248295-dafe-4251-81f9-a30eafde0c89 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:29.865701 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-70248295-dafe-4251-81f9-a30eafde0c89 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:29.866398 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-70248295-dafe-4251-81f9-a30eafde0c89 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:29.867107 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-70248295-dafe-4251-81f9-a30eafde0c89 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:30.010785 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-70248295-dafe-4251-81f9-a30eafde0c89 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:30.019136 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-70248295-dafe-4251-81f9-a30eafde0c89 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:30.020695 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-70248295-dafe-4251-81f9-a30eafde0c89 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:30.022785 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-70248295-dafe-4251-81f9-a30eafde0c89 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1724 microversion: 2.20 time: 0.172964 Sep 06 01:17:30.024191 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 455/887] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:17:29 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:17:30.047205 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-61c231af-b21e-41b7-8198-933a49fe96f5 tempest-VolumesGetTestJSON-1816309885 tempest-VolumesGetTestJSON-1816309885-project] Action: 'create', calling method: .version_select at 0x7fb06e143ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1306639404", "metadata": {"Type": "work"}}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:17:30.331023 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-61c231af-b21e-41b7-8198-933a49fe96f5 tempest-VolumesGetTestJSON-1816309885 tempest-VolumesGetTestJSON-1816309885-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.423559 Sep 06 01:17:30.332287 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 433/888] 10.222.0.23 () {60 vars in 1156 bytes} [Tue Sep 6 01:17:29 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 426 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 06 01:17:30.346609 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-fefecf68-df7a-4500-8f72-3d3da7360612 tempest-VolumesGetTestJSON-1816309885 tempest-VolumesGetTestJSON-1816309885-project] Calling method '.version_select at 0x7fb06e1158b0>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:30.397276 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-fefecf68-df7a-4500-8f72-3d3da7360612 tempest-VolumesGetTestJSON-1816309885 tempest-VolumesGetTestJSON-1816309885-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/5998a276-037b-41b0-bdc0-16fd3b3d6f59" status: 200 len: 353 microversion: 2.1 time: 0.054508 Sep 06 01:17:30.397911 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 456/889] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Sep 6 01:17:30 2022] GET /compute/v2.1/os-volumes/5998a276-037b-41b0-bdc0-16fd3b3d6f59 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:17:30.471359 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-305fd69b-2e50-4840-837a-2008d57b3c8c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:30.472015 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-305fd69b-2e50-4840-837a-2008d57b3c8c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: 1a77e639-92e6-4c82-888f-423ae3a0d290] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:30.478475 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-305fd69b-2e50-4840-837a-2008d57b3c8c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:30.478962 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-305fd69b-2e50-4840-837a-2008d57b3c8c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:30.479400 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-305fd69b-2e50-4840-837a-2008d57b3c8c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:30.480120 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-305fd69b-2e50-4840-837a-2008d57b3c8c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:30.480584 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-305fd69b-2e50-4840-837a-2008d57b3c8c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:30.481011 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-305fd69b-2e50-4840-837a-2008d57b3c8c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:30.612776 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-305fd69b-2e50-4840-837a-2008d57b3c8c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:30.621354 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-305fd69b-2e50-4840-837a-2008d57b3c8c tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290" status: 200 len: 1361 microversion: 2.1 time: 0.154058 Sep 06 01:17:30.621907 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 434/890] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:30 2022] GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:17:31.048563 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-859e468d-b714-405a-af41-5789bc91a5e9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:31.049179 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-859e468d-b714-405a-af41-5789bc91a5e9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:31.055080 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-859e468d-b714-405a-af41-5789bc91a5e9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:31.055566 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-859e468d-b714-405a-af41-5789bc91a5e9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:31.056041 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-859e468d-b714-405a-af41-5789bc91a5e9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:31.056729 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-859e468d-b714-405a-af41-5789bc91a5e9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:31.057186 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-859e468d-b714-405a-af41-5789bc91a5e9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:31.057611 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-859e468d-b714-405a-af41-5789bc91a5e9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:31.182700 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-859e468d-b714-405a-af41-5789bc91a5e9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:31.190672 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-859e468d-b714-405a-af41-5789bc91a5e9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:31.192161 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-859e468d-b714-405a-af41-5789bc91a5e9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:31.194359 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-859e468d-b714-405a-af41-5789bc91a5e9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1724 microversion: 2.20 time: 0.150242 Sep 06 01:17:31.194920 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 457/891] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:17:31 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:17:31.411704 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cfc73b3e-b2a8-4ead-8924-56495a39efd4 tempest-VolumesGetTestJSON-1816309885 tempest-VolumesGetTestJSON-1816309885-project] Calling method '.version_select at 0x7fb06e143700>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:31.457251 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cfc73b3e-b2a8-4ead-8924-56495a39efd4 tempest-VolumesGetTestJSON-1816309885 tempest-VolumesGetTestJSON-1816309885-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/5998a276-037b-41b0-bdc0-16fd3b3d6f59" status: 200 len: 354 microversion: 2.1 time: 0.049390 Sep 06 01:17:31.457808 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 435/892] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Sep 6 01:17:31 2022] GET /compute/v2.1/os-volumes/5998a276-037b-41b0-bdc0-16fd3b3d6f59 => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:17:31.470928 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-d4d388bc-338a-4071-a3bf-bb3c326600c7 tempest-VolumesGetTestJSON-1816309885 tempest-VolumesGetTestJSON-1816309885-project] Calling method '.version_select at 0x7fb06e0bf8b0>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:31.516312 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-d4d388bc-338a-4071-a3bf-bb3c326600c7 tempest-VolumesGetTestJSON-1816309885 tempest-VolumesGetTestJSON-1816309885-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/5998a276-037b-41b0-bdc0-16fd3b3d6f59" status: 200 len: 354 microversion: 2.1 time: 0.049021 Sep 06 01:17:31.516896 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 458/893] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Sep 6 01:17:31 2022] GET /compute/v2.1/os-volumes/5998a276-037b-41b0-bdc0-16fd3b3d6f59 => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:17:31.534766 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-44553231-bb27-4acf-a5a9-5ee9c43e25d9 tempest-VolumesGetTestJSON-1816309885 tempest-VolumesGetTestJSON-1816309885-project] Calling method '.version_select at 0x7fb06e05f700>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:31.595551 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-44553231-bb27-4acf-a5a9-5ee9c43e25d9 tempest-VolumesGetTestJSON-1816309885 tempest-VolumesGetTestJSON-1816309885-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/5998a276-037b-41b0-bdc0-16fd3b3d6f59" status: 202 len: 0 microversion: 2.1 time: 0.064474 Sep 06 01:17:31.596159 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 436/894] 10.222.0.23 () {58 vars in 1248 bytes} [Tue Sep 6 01:17:31 2022] DELETE /compute/v2.1/os-volumes/5998a276-037b-41b0-bdc0-16fd3b3d6f59 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 01:17:31.604047 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-7e70bac2-3881-47ca-8102-4182b723c9ad tempest-VolumesGetTestJSON-1816309885 tempest-VolumesGetTestJSON-1816309885-project] Calling method '.version_select at 0x7fb06dfe1ee0>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:31.644505 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1fee04bc-7307-46e3-ba35-ec11ee44aa66 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:31.645117 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1fee04bc-7307-46e3-ba35-ec11ee44aa66 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: 1a77e639-92e6-4c82-888f-423ae3a0d290] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:31.651626 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1fee04bc-7307-46e3-ba35-ec11ee44aa66 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:31.652149 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1fee04bc-7307-46e3-ba35-ec11ee44aa66 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:31.652383 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-7e70bac2-3881-47ca-8102-4182b723c9ad tempest-VolumesGetTestJSON-1816309885 tempest-VolumesGetTestJSON-1816309885-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/5998a276-037b-41b0-bdc0-16fd3b3d6f59" status: 200 len: 353 microversion: 2.1 time: 0.051858 Sep 06 01:17:31.652586 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1fee04bc-7307-46e3-ba35-ec11ee44aa66 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:31.656264 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1fee04bc-7307-46e3-ba35-ec11ee44aa66 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:31.656398 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 459/895] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Sep 6 01:17:31 2022] GET /compute/v2.1/os-volumes/5998a276-037b-41b0-bdc0-16fd3b3d6f59 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:17:31.656493 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1fee04bc-7307-46e3-ba35-ec11ee44aa66 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:31.656493 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1fee04bc-7307-46e3-ba35-ec11ee44aa66 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:31.786170 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-1fee04bc-7307-46e3-ba35-ec11ee44aa66 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:31.794262 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1fee04bc-7307-46e3-ba35-ec11ee44aa66 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290" status: 200 len: 1361 microversion: 2.1 time: 0.153616 Sep 06 01:17:31.794964 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 437/896] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:31 2022] GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:17:32.005747 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-34134068-63c0-4f51-a551-8aa0f49faaed req-9ad5121f-1fe1-47f7-8acb-5c0f56abc592 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a77e639-92e6-4c82-888f-423ae3a0d290", "name": "network-vif-plugged", "status": "completed", "tag": "7e16664d-c221-4c8e-9a39-00aed6e29f44"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:17:32.016061 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-34134068-63c0-4f51-a551-8aa0f49faaed req-9ad5121f-1fe1-47f7-8acb-5c0f56abc592 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:32.016557 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-34134068-63c0-4f51-a551-8aa0f49faaed req-9ad5121f-1fe1-47f7-8acb-5c0f56abc592 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:32.016994 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-34134068-63c0-4f51-a551-8aa0f49faaed req-9ad5121f-1fe1-47f7-8acb-5c0f56abc592 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:32.026997 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.compute.server_external_events [req-34134068-63c0-4f51-a551-8aa0f49faaed req-9ad5121f-1fe1-47f7-8acb-5c0f56abc592 service nova] Creating event network-vif-plugged:7e16664d-c221-4c8e-9a39-00aed6e29f44 for instance 1a77e639-92e6-4c82-888f-423ae3a0d290 on hv-cinder-84773 Sep 06 01:17:32.031948 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [req-34134068-63c0-4f51-a551-8aa0f49faaed req-9ad5121f-1fe1-47f7-8acb-5c0f56abc592 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095906 Sep 06 01:17:32.032513 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 460/897] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:17:32.220497 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3403adc2-0482-478f-be51-5105784d85da tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:32.221105 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3403adc2-0482-478f-be51-5105784d85da tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:32.227497 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3403adc2-0482-478f-be51-5105784d85da tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:32.228007 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3403adc2-0482-478f-be51-5105784d85da tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:32.228446 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3403adc2-0482-478f-be51-5105784d85da tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:32.229127 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3403adc2-0482-478f-be51-5105784d85da tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:32.229582 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3403adc2-0482-478f-be51-5105784d85da tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:32.229995 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3403adc2-0482-478f-be51-5105784d85da tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:32.360756 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-3403adc2-0482-478f-be51-5105784d85da tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:32.369242 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-3403adc2-0482-478f-be51-5105784d85da tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:32.370936 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-3403adc2-0482-478f-be51-5105784d85da tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:32.372294 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3403adc2-0482-478f-be51-5105784d85da tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1724 microversion: 2.20 time: 0.155726 Sep 06 01:17:32.372859 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 438/898] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:17:32 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:17:32.664607 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell0:SELECT=2 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:17:32.665357 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell0:SELECT=6 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:17:32.669721 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-2a5cf706-9ffd-40f4-a3ae-14d5af2b134f tempest-VolumesGetTestJSON-1816309885 tempest-VolumesGetTestJSON-1816309885-project] Calling method '.version_select at 0x7fb06e1158b0>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:32.698284 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.wsgi [None req-2a5cf706-9ffd-40f4-a3ae-14d5af2b134f tempest-VolumesGetTestJSON-1816309885 tempest-VolumesGetTestJSON-1816309885-project] HTTP exception thrown: Volume 5998a276-037b-41b0-bdc0-16fd3b3d6f59 could not be found. Sep 06 01:17:32.700425 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-2a5cf706-9ffd-40f4-a3ae-14d5af2b134f tempest-VolumesGetTestJSON-1816309885 tempest-VolumesGetTestJSON-1816309885-project] Request method failure captured: Sep 06 01:17:32.700425 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: request: GET /compute/v2.1/os-volumes/5998a276-037b-41b0-bdc0-16fd3b3d6f59 HTTP/1.1 Sep 06 01:17:32.700425 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept: application/json Sep 06 01:17:32.700425 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept-Encoding: identity Sep 06 01:17:32.700425 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Connection: close Sep 06 01:17:32.700425 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Length: 0 Sep 06 01:17:32.700425 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Type: application/json Sep 06 01:17:32.700425 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Host: 10.222.0.23 Sep 06 01:17:32.700425 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Openstack-System-Scope: None Sep 06 01:17:32.700425 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: User-Agent: python-urllib3/1.26.12 Sep 06 01:17:32.700425 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Auth-Token: gAAAAABjFp-p6mZcLCb5_7Pq7d5RaO_GuCYa61lj6VPFOwberdlhAW9tqHekk0FqWbUDzwJrL9YkRxnZDsjavCjfflX9DWu8hY-y61hydfkC0CpAClU6lhYKIr2wdlXOzs8koDWvpTnBxVAxQrtgTfmZqROWnnER3YLsFW_mbMlzb_4ixPisfy4 Sep 06 01:17:32.700425 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Id: None Sep 06 01:17:32.700425 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Name: None Sep 06 01:17:32.700425 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Identity-Status: Confirmed Sep 06 01:17:32.700425 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Is-Admin-Project: True Sep 06 01:17:32.700425 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Id: default Sep 06 01:17:32.700425 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Name: Default Sep 06 01:17:32.700425 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Id: ff3cfc7a0545454eb53bae1dc4086900 Sep 06 01:17:32.700425 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Name: tempest-VolumesGetTestJSON-1816309885 Sep 06 01:17:32.700425 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Role: reader,member Sep 06 01:17:32.700425 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Roles: reader,member Sep 06 01:17:32.701926 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ff3cfc7a0545454eb53bae1dc4086900"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ff3cfc7a0545454eb53bae1dc4086900"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ff3cfc7a0545454eb53bae1dc4086900"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ff3cfc7a0545454eb53bae1dc4086900"}]}] Sep 06 01:17:32.701926 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant: tempest-VolumesGetTestJSON-1816309885 Sep 06 01:17:32.701926 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Id: ff3cfc7a0545454eb53bae1dc4086900 Sep 06 01:17:32.701926 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Name: tempest-VolumesGetTestJSON-1816309885 Sep 06 01:17:32.701926 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User: tempest-VolumesGetTestJSON-1816309885-project Sep 06 01:17:32.701926 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Id: default Sep 06 01:17:32.701926 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Name: Default Sep 06 01:17:32.701926 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Id: 717cbcb67fe34b68b7d4796c07531a3e Sep 06 01:17:32.701926 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Name: tempest-VolumesGetTestJSON-1816309885-project Sep 06 01:17:32.701926 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: method: Sep 06 01:17:32.701926 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: exception: Volume 5998a276-037b-41b0-bdc0-16fd3b3d6f59 could not be found. Sep 06 01:17:32.701926 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: action_args: {'id': '5998a276-037b-41b0-bdc0-16fd3b3d6f59'} Sep 06 01:17:32.701926 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:17:32.702888 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:17:32.702888 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 01:17:32.702888 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 01:17:32.702888 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 01:17:32.702888 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 01:17:32.702888 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 01:17:32.702888 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 01:17:32.702888 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 01:17:32.702888 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 01:17:32.702888 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 01:17:32.702888 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 01:17:32.702888 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 01:17:32.702888 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 01:17:32.702888 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 01:17:32.702888 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 01:17:32.702888 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5998a276-037b-41b0-bdc0-16fd3b3d6f59 could not be found. (HTTP 404) (Request-ID: req-7ea1e348-01ab-44fc-8062-38a855abb3c1) Sep 06 01:17:32.702888 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:17:32.702888 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:17:32.702888 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:17:32.704327 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:17:32.704327 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 06 01:17:32.704327 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 06 01:17:32.704327 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 01:17:32.704327 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 01:17:32.704327 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 01:17:32.704327 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 01:17:32.704327 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 01:17:32.704327 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 01:17:32.704327 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 01:17:32.704327 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 01:17:32.704327 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 01:17:32.704327 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 01:17:32.704327 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 01:17:32.704327 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 01:17:32.704327 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 01:17:32.704327 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 01:17:32.704327 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 01:17:32.704327 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 01:17:32.705928 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 01:17:32.705928 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 01:17:32.705928 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 01:17:32.705928 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 01:17:32.705928 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5998a276-037b-41b0-bdc0-16fd3b3d6f59 could not be found. Sep 06 01:17:32.705928 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:17:32.705928 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:17:32.705928 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:17:32.705928 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:17:32.705928 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:17:32.705928 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:17:32.705928 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:17:32.705928 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:17:32.705928 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 01:17:32.705928 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 01:17:32.705928 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:17:32.705928 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:17:32.705928 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 06 01:17:32.705928 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:17:32.707443 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5998a276-037b-41b0-bdc0-16fd3b3d6f59 could not be found. Sep 06 01:17:32.707443 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:17:32.707443 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:17:32.707443 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:17:32.707443 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:17:32.707443 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:17:32.707443 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:17:32.707443 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:17:32.707443 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:17:32.707443 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5998a276-037b-41b0-bdc0-16fd3b3d6f59 could not be found. Sep 06 01:17:32.707443 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:17:32.707443 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-2a5cf706-9ffd-40f4-a3ae-14d5af2b134f tempest-VolumesGetTestJSON-1816309885 tempest-VolumesGetTestJSON-1816309885-project] Returning 404 to user: Volume 5998a276-037b-41b0-bdc0-16fd3b3d6f59 could not be found. {{(pid=120580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:17:32.707443 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-2a5cf706-9ffd-40f4-a3ae-14d5af2b134f tempest-VolumesGetTestJSON-1816309885 tempest-VolumesGetTestJSON-1816309885-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/5998a276-037b-41b0-bdc0-16fd3b3d6f59" status: 404 len: 109 microversion: 2.1 time: 0.038730 Sep 06 01:17:32.707443 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 461/899] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Sep 6 01:17:32 2022] GET /compute/v2.1/os-volumes/5998a276-037b-41b0-bdc0-16fd3b3d6f59 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 01:17:32.821476 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-39db21fb-ef8c-4cb1-9ea0-2ee27f42e064 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:32.822001 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-39db21fb-ef8c-4cb1-9ea0-2ee27f42e064 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: 1a77e639-92e6-4c82-888f-423ae3a0d290] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:32.824547 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:17:32.830924 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39db21fb-ef8c-4cb1-9ea0-2ee27f42e064 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:32.831541 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39db21fb-ef8c-4cb1-9ea0-2ee27f42e064 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:32.832262 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39db21fb-ef8c-4cb1-9ea0-2ee27f42e064 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:32.833415 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39db21fb-ef8c-4cb1-9ea0-2ee27f42e064 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:32.834857 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39db21fb-ef8c-4cb1-9ea0-2ee27f42e064 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:32.835560 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39db21fb-ef8c-4cb1-9ea0-2ee27f42e064 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:32.969042 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-39db21fb-ef8c-4cb1-9ea0-2ee27f42e064 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:32.976937 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-39db21fb-ef8c-4cb1-9ea0-2ee27f42e064 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290" status: 200 len: 1361 microversion: 2.1 time: 0.159960 Sep 06 01:17:32.977479 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 439/900] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:32 2022] GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:17:33.396935 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-bc63ada0-b603-44de-adcb-10543d06fdb1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:33.397650 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-bc63ada0-b603-44de-adcb-10543d06fdb1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:33.405054 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-bc63ada0-b603-44de-adcb-10543d06fdb1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:33.405840 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-bc63ada0-b603-44de-adcb-10543d06fdb1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:33.406288 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-bc63ada0-b603-44de-adcb-10543d06fdb1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:33.407250 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-bc63ada0-b603-44de-adcb-10543d06fdb1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:33.407713 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-bc63ada0-b603-44de-adcb-10543d06fdb1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:33.408166 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-bc63ada0-b603-44de-adcb-10543d06fdb1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:33.544011 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-bc63ada0-b603-44de-adcb-10543d06fdb1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:33.552128 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-bc63ada0-b603-44de-adcb-10543d06fdb1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:33.554150 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-bc63ada0-b603-44de-adcb-10543d06fdb1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:33.555320 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-bc63ada0-b603-44de-adcb-10543d06fdb1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1745 microversion: 2.20 time: 0.162270 Sep 06 01:17:33.555889 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 462/901] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:17:33 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:17:33.999801 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bed91abf-849e-4316-b204-057c61a9325a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:34.000420 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bed91abf-849e-4316-b204-057c61a9325a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: 1a77e639-92e6-4c82-888f-423ae3a0d290] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:34.007219 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bed91abf-849e-4316-b204-057c61a9325a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:34.008141 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bed91abf-849e-4316-b204-057c61a9325a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:34.008767 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bed91abf-849e-4316-b204-057c61a9325a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:34.009638 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bed91abf-849e-4316-b204-057c61a9325a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:34.010258 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bed91abf-849e-4316-b204-057c61a9325a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:34.010843 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bed91abf-849e-4316-b204-057c61a9325a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:34.160654 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-bed91abf-849e-4316-b204-057c61a9325a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:34.172103 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bed91abf-849e-4316-b204-057c61a9325a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290" status: 200 len: 1361 microversion: 2.1 time: 0.176267 Sep 06 01:17:34.173062 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 440/902] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:33 2022] GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290 => generated 1361 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:17:34.583162 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-67a93da8-61ff-4b26-9c47-0981cfe5779b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:34.584393 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-67a93da8-61ff-4b26-9c47-0981cfe5779b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:34.591173 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-67a93da8-61ff-4b26-9c47-0981cfe5779b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:34.591660 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-67a93da8-61ff-4b26-9c47-0981cfe5779b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:34.592130 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-67a93da8-61ff-4b26-9c47-0981cfe5779b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:34.592832 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-67a93da8-61ff-4b26-9c47-0981cfe5779b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:34.593286 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-67a93da8-61ff-4b26-9c47-0981cfe5779b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:34.593705 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-67a93da8-61ff-4b26-9c47-0981cfe5779b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:34.737486 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-67a93da8-61ff-4b26-9c47-0981cfe5779b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:34.746301 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-67a93da8-61ff-4b26-9c47-0981cfe5779b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:34.747767 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-67a93da8-61ff-4b26-9c47-0981cfe5779b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:34.749017 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-67a93da8-61ff-4b26-9c47-0981cfe5779b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1745 microversion: 2.20 time: 0.169929 Sep 06 01:17:34.750349 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 463/903] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:17:34 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:17:35.196393 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5009fa74-b445-4f29-b4e0-079f7e6cf8d5 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:35.197010 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5009fa74-b445-4f29-b4e0-079f7e6cf8d5 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: 1a77e639-92e6-4c82-888f-423ae3a0d290] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:35.204157 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5009fa74-b445-4f29-b4e0-079f7e6cf8d5 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:35.204538 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5009fa74-b445-4f29-b4e0-079f7e6cf8d5 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:35.205188 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5009fa74-b445-4f29-b4e0-079f7e6cf8d5 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:35.206436 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5009fa74-b445-4f29-b4e0-079f7e6cf8d5 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:35.206909 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5009fa74-b445-4f29-b4e0-079f7e6cf8d5 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:35.207302 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5009fa74-b445-4f29-b4e0-079f7e6cf8d5 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:35.212561 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:17:35.376542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-5009fa74-b445-4f29-b4e0-079f7e6cf8d5 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:35.385781 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5009fa74-b445-4f29-b4e0-079f7e6cf8d5 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290" status: 200 len: 1547 microversion: 2.1 time: 0.193647 Sep 06 01:17:35.386967 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 441/904] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:35 2022] GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290 => generated 1547 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:17:35.410982 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-edc06672-363e-4717-99fc-29afe4e7b611 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:35.416754 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-edc06672-363e-4717-99fc-29afe4e7b611 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: 1a77e639-92e6-4c82-888f-423ae3a0d290] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:35.427206 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-edc06672-363e-4717-99fc-29afe4e7b611 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:35.428056 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-edc06672-363e-4717-99fc-29afe4e7b611 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:35.430696 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-edc06672-363e-4717-99fc-29afe4e7b611 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:35.431499 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-edc06672-363e-4717-99fc-29afe4e7b611 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:35.432064 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-edc06672-363e-4717-99fc-29afe4e7b611 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:35.438456 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-edc06672-363e-4717-99fc-29afe4e7b611 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:35.553404 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-edc06672-363e-4717-99fc-29afe4e7b611 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.146741 Sep 06 01:17:35.554288 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 464/905] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Sep 6 01:17:35 2022] GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290/os-interface => generated 284 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:17:35.776612 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b5ffeb7c-a9c0-4d25-900c-aed94577d3bc tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:35.778041 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b5ffeb7c-a9c0-4d25-900c-aed94577d3bc tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:35.787873 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b5ffeb7c-a9c0-4d25-900c-aed94577d3bc tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:35.796416 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b5ffeb7c-a9c0-4d25-900c-aed94577d3bc tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:35.797020 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b5ffeb7c-a9c0-4d25-900c-aed94577d3bc tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:35.798709 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b5ffeb7c-a9c0-4d25-900c-aed94577d3bc tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:35.800684 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b5ffeb7c-a9c0-4d25-900c-aed94577d3bc tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:35.811802 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b5ffeb7c-a9c0-4d25-900c-aed94577d3bc tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:36.084355 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-7eb6450c-cf63-4e89-b7aa-565b839c2bbc req-8cf63ef9-43e4-49e3-9c07-e62b92d2087c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "366390df-669b-48b1-b741-56d5fdd64441", "name": "network-vif-plugged", "status": "completed", "tag": "703a4acd-427c-4fd4-bf73-f445a5bcac26"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:17:36.125657 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-7eb6450c-cf63-4e89-b7aa-565b839c2bbc req-8cf63ef9-43e4-49e3-9c07-e62b92d2087c service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:36.127093 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-7eb6450c-cf63-4e89-b7aa-565b839c2bbc req-8cf63ef9-43e4-49e3-9c07-e62b92d2087c service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:36.129243 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-7eb6450c-cf63-4e89-b7aa-565b839c2bbc req-8cf63ef9-43e4-49e3-9c07-e62b92d2087c service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:36.162526 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.compute.server_external_events [req-7eb6450c-cf63-4e89-b7aa-565b839c2bbc req-8cf63ef9-43e4-49e3-9c07-e62b92d2087c service nova] Creating event network-vif-plugged:703a4acd-427c-4fd4-bf73-f445a5bcac26 for instance 366390df-669b-48b1-b741-56d5fdd64441 on hv-cinder-84773 Sep 06 01:17:36.177971 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-b5ffeb7c-a9c0-4d25-900c-aed94577d3bc tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:36.187586 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-b5ffeb7c-a9c0-4d25-900c-aed94577d3bc tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:36.188740 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [req-7eb6450c-cf63-4e89-b7aa-565b839c2bbc req-8cf63ef9-43e4-49e3-9c07-e62b92d2087c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105076 Sep 06 01:17:36.190311 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 465/906] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:17:36.201538 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-b5ffeb7c-a9c0-4d25-900c-aed94577d3bc tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:36.202779 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b5ffeb7c-a9c0-4d25-900c-aed94577d3bc tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1740 microversion: 2.20 time: 0.431937 Sep 06 01:17:36.203638 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 442/907] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:17:35 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1740 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:17:37.132556 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-77731caf-3c8e-4ae6-b134-67bdb909ef17 req-065a697a-2eeb-43cd-ad1e-46f7011655c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a77e639-92e6-4c82-888f-423ae3a0d290", "tag": "7e16664d-c221-4c8e-9a39-00aed6e29f44"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:17:37.150420 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-77731caf-3c8e-4ae6-b134-67bdb909ef17 req-065a697a-2eeb-43cd-ad1e-46f7011655c1 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:37.154167 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-77731caf-3c8e-4ae6-b134-67bdb909ef17 req-065a697a-2eeb-43cd-ad1e-46f7011655c1 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:37.154784 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-77731caf-3c8e-4ae6-b134-67bdb909ef17 req-065a697a-2eeb-43cd-ad1e-46f7011655c1 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:37.172550 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.compute.server_external_events [req-77731caf-3c8e-4ae6-b134-67bdb909ef17 req-065a697a-2eeb-43cd-ad1e-46f7011655c1 service nova] Creating event network-changed:7e16664d-c221-4c8e-9a39-00aed6e29f44 for instance 1a77e639-92e6-4c82-888f-423ae3a0d290 on hv-cinder-84773 Sep 06 01:17:37.179283 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [req-77731caf-3c8e-4ae6-b134-67bdb909ef17 req-065a697a-2eeb-43cd-ad1e-46f7011655c1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051474 Sep 06 01:17:37.185236 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 466/908] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:17:37.234958 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2e9824df-79d7-4e9c-9c37-847bd7164ca4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:37.236548 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2e9824df-79d7-4e9c-9c37-847bd7164ca4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:37.250064 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e9824df-79d7-4e9c-9c37-847bd7164ca4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:37.250783 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e9824df-79d7-4e9c-9c37-847bd7164ca4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:37.251440 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e9824df-79d7-4e9c-9c37-847bd7164ca4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:37.252417 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e9824df-79d7-4e9c-9c37-847bd7164ca4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:37.253099 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e9824df-79d7-4e9c-9c37-847bd7164ca4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:37.253716 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e9824df-79d7-4e9c-9c37-847bd7164ca4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:37.544280 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-2e9824df-79d7-4e9c-9c37-847bd7164ca4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:37.560462 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-2e9824df-79d7-4e9c-9c37-847bd7164ca4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:37.564286 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-2e9824df-79d7-4e9c-9c37-847bd7164ca4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:37.566068 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2e9824df-79d7-4e9c-9c37-847bd7164ca4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1740 microversion: 2.20 time: 0.337154 Sep 06 01:17:37.567526 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 443/909] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:17:37 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1740 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:17:38.599939 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-265426d1-9b98-40ff-be98-be2bed3fcdeb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:38.601676 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-265426d1-9b98-40ff-be98-be2bed3fcdeb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:38.620411 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-265426d1-9b98-40ff-be98-be2bed3fcdeb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:38.621247 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-265426d1-9b98-40ff-be98-be2bed3fcdeb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:38.621869 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-265426d1-9b98-40ff-be98-be2bed3fcdeb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:38.622910 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-265426d1-9b98-40ff-be98-be2bed3fcdeb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:38.623523 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-265426d1-9b98-40ff-be98-be2bed3fcdeb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:38.624131 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-265426d1-9b98-40ff-be98-be2bed3fcdeb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:38.853734 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-265426d1-9b98-40ff-be98-be2bed3fcdeb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:38.862817 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-265426d1-9b98-40ff-be98-be2bed3fcdeb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:38.871481 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-265426d1-9b98-40ff-be98-be2bed3fcdeb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:38.872740 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-265426d1-9b98-40ff-be98-be2bed3fcdeb tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1740 microversion: 2.20 time: 0.281695 Sep 06 01:17:38.875553 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 467/910] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:17:38 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1740 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:17:39.900600 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-52034d9c-781b-493e-b50d-e29e78ce96ad tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:39.901845 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-52034d9c-781b-493e-b50d-e29e78ce96ad tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:39.909297 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-52034d9c-781b-493e-b50d-e29e78ce96ad tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:39.910016 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-52034d9c-781b-493e-b50d-e29e78ce96ad tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:39.911180 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-52034d9c-781b-493e-b50d-e29e78ce96ad tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:39.912553 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-52034d9c-781b-493e-b50d-e29e78ce96ad tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:39.913172 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-52034d9c-781b-493e-b50d-e29e78ce96ad tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:39.914217 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-52034d9c-781b-493e-b50d-e29e78ce96ad tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:40.070599 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-52034d9c-781b-493e-b50d-e29e78ce96ad tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:40.080000 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-52034d9c-781b-493e-b50d-e29e78ce96ad tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:40.081439 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-52034d9c-781b-493e-b50d-e29e78ce96ad tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:40.082934 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-52034d9c-781b-493e-b50d-e29e78ce96ad tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1740 microversion: 2.20 time: 0.188265 Sep 06 01:17:40.084441 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 444/911] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:17:39 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1740 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:17:41.112828 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-c6a91029-b0cb-4ec7-8bf3-59bf532f7453 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:41.114163 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-c6a91029-b0cb-4ec7-8bf3-59bf532f7453 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:41.121471 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c6a91029-b0cb-4ec7-8bf3-59bf532f7453 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:41.122184 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c6a91029-b0cb-4ec7-8bf3-59bf532f7453 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:41.122891 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c6a91029-b0cb-4ec7-8bf3-59bf532f7453 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:41.124021 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c6a91029-b0cb-4ec7-8bf3-59bf532f7453 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:41.124693 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c6a91029-b0cb-4ec7-8bf3-59bf532f7453 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:41.125328 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c6a91029-b0cb-4ec7-8bf3-59bf532f7453 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:41.277980 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-c6a91029-b0cb-4ec7-8bf3-59bf532f7453 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:41.289673 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-c6a91029-b0cb-4ec7-8bf3-59bf532f7453 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:41.291453 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-c6a91029-b0cb-4ec7-8bf3-59bf532f7453 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:41.292996 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-c6a91029-b0cb-4ec7-8bf3-59bf532f7453 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1740 microversion: 2.20 time: 0.184251 Sep 06 01:17:41.293707 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 468/912] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:17:41 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:17:42.324602 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ecd768ac-a3c6-4c9b-aabd-dbfdf6540fc4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:42.325233 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ecd768ac-a3c6-4c9b-aabd-dbfdf6540fc4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:42.332734 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ecd768ac-a3c6-4c9b-aabd-dbfdf6540fc4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:42.333893 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ecd768ac-a3c6-4c9b-aabd-dbfdf6540fc4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:42.334794 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ecd768ac-a3c6-4c9b-aabd-dbfdf6540fc4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:42.336106 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ecd768ac-a3c6-4c9b-aabd-dbfdf6540fc4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:42.336917 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ecd768ac-a3c6-4c9b-aabd-dbfdf6540fc4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:42.337363 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ecd768ac-a3c6-4c9b-aabd-dbfdf6540fc4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:42.481707 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-ecd768ac-a3c6-4c9b-aabd-dbfdf6540fc4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:42.490333 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-ecd768ac-a3c6-4c9b-aabd-dbfdf6540fc4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:42.491959 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-ecd768ac-a3c6-4c9b-aabd-dbfdf6540fc4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:42.493485 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ecd768ac-a3c6-4c9b-aabd-dbfdf6540fc4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1740 microversion: 2.20 time: 0.176871 Sep 06 01:17:42.494145 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 445/913] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:17:42 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:17:42.595169 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-ee287ac5-4009-482e-b966-c27cd675b9ae tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-896786906"}} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:17:42.595706 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-ee287ac5-4009-482e-b966-c27cd675b9ae tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:42.602915 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ee287ac5-4009-482e-b966-c27cd675b9ae tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:42.603407 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ee287ac5-4009-482e-b966-c27cd675b9ae tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:42.603887 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ee287ac5-4009-482e-b966-c27cd675b9ae tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:42.604595 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ee287ac5-4009-482e-b966-c27cd675b9ae tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:42.605051 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ee287ac5-4009-482e-b966-c27cd675b9ae tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:42.605478 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ee287ac5-4009-482e-b966-c27cd675b9ae tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:42.750172 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.network.security_group_api [None req-ee287ac5-4009-482e-b966-c27cd675b9ae tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Removing security group 8dd9b9fb-bcd4-4fed-b566-b46e843aff05 from port c382089c-3c7e-40e3-825b-3469de858075 Sep 06 01:17:43.120932 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-ee287ac5-4009-482e-b966-c27cd675b9ae tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "POST /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d/action" status: 202 len: 0 microversion: 2.1 time: 0.529404 Sep 06 01:17:43.121301 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 469/914] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Sep 6 01:17:42 2022] POST /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d/action => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 01:17:43.135850 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-ecbafdda-0e5c-4936-8ffe-669ae80e571f req-e41f0179-c759-48ee-8d06-79b596e4f90a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "590890af-37ec-4cde-b2f7-0b20cc31b43d", "tag": "c382089c-3c7e-40e3-825b-3469de858075"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:17:43.146913 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ecbafdda-0e5c-4936-8ffe-669ae80e571f req-e41f0179-c759-48ee-8d06-79b596e4f90a service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:43.147691 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ecbafdda-0e5c-4936-8ffe-669ae80e571f req-e41f0179-c759-48ee-8d06-79b596e4f90a service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:43.148331 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ecbafdda-0e5c-4936-8ffe-669ae80e571f req-e41f0179-c759-48ee-8d06-79b596e4f90a service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:43.165851 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-ecbafdda-0e5c-4936-8ffe-669ae80e571f req-e41f0179-c759-48ee-8d06-79b596e4f90a service nova] Creating event network-changed:c382089c-3c7e-40e3-825b-3469de858075 for instance 590890af-37ec-4cde-b2f7-0b20cc31b43d on hv-cinder-84773 Sep 06 01:17:43.171872 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-ecbafdda-0e5c-4936-8ffe-669ae80e571f req-e41f0179-c759-48ee-8d06-79b596e4f90a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042833 Sep 06 01:17:43.173221 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 446/915] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:17:43.519546 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-4edd715f-681b-4688-b9a7-5edd64706ff2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:43.520332 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-4edd715f-681b-4688-b9a7-5edd64706ff2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:43.527365 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4edd715f-681b-4688-b9a7-5edd64706ff2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:43.528060 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4edd715f-681b-4688-b9a7-5edd64706ff2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:43.528593 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4edd715f-681b-4688-b9a7-5edd64706ff2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:43.529397 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4edd715f-681b-4688-b9a7-5edd64706ff2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:43.529950 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4edd715f-681b-4688-b9a7-5edd64706ff2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:43.530472 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4edd715f-681b-4688-b9a7-5edd64706ff2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:43.805816 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-4edd715f-681b-4688-b9a7-5edd64706ff2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:43.817337 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-4edd715f-681b-4688-b9a7-5edd64706ff2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:43.820190 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-4edd715f-681b-4688-b9a7-5edd64706ff2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:43.831281 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-4edd715f-681b-4688-b9a7-5edd64706ff2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1740 microversion: 2.20 time: 0.315563 Sep 06 01:17:43.832877 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 470/916] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:17:43 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1740 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:17:44.386609 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3c9f5062-41c5-4f6f-b899-6186a2a8ce74 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:44.387227 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3c9f5062-41c5-4f6f-b899-6186a2a8ce74 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:44.393794 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c9f5062-41c5-4f6f-b899-6186a2a8ce74 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:44.394550 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c9f5062-41c5-4f6f-b899-6186a2a8ce74 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:44.395161 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c9f5062-41c5-4f6f-b899-6186a2a8ce74 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:44.396101 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c9f5062-41c5-4f6f-b899-6186a2a8ce74 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:44.396711 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c9f5062-41c5-4f6f-b899-6186a2a8ce74 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:44.397292 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c9f5062-41c5-4f6f-b899-6186a2a8ce74 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:44.500871 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-3c9f5062-41c5-4f6f-b899-6186a2a8ce74 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lazy-loading 'services' on Instance uuid 590890af-37ec-4cde-b2f7-0b20cc31b43d {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 01:17:44.602126 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3c9f5062-41c5-4f6f-b899-6186a2a8ce74 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "DELETE /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d/os-volume_attachments/0501b5ca-12b9-4092-acee-db360247b463" status: 202 len: 0 microversion: 2.1 time: 0.220145 Sep 06 01:17:44.607105 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 447/917] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Sep 6 01:17:44 2022] DELETE /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d/os-volume_attachments/0501b5ca-12b9-4092-acee-db360247b463 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 01:17:44.611882 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-a6e9ba0b-0593-4ec8-ab12-9cde38c73578 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:44.615593 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-a6e9ba0b-0593-4ec8-ab12-9cde38c73578 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:44.622370 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a6e9ba0b-0593-4ec8-ab12-9cde38c73578 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:44.623012 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a6e9ba0b-0593-4ec8-ab12-9cde38c73578 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:44.623552 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a6e9ba0b-0593-4ec8-ab12-9cde38c73578 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:44.624554 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a6e9ba0b-0593-4ec8-ab12-9cde38c73578 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:44.625084 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a6e9ba0b-0593-4ec8-ab12-9cde38c73578 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:44.625583 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a6e9ba0b-0593-4ec8-ab12-9cde38c73578 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:44.645421 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell1:SELECT=100 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:17:44.659552 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-a6e9ba0b-0593-4ec8-ab12-9cde38c73578 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051591 Sep 06 01:17:44.660235 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 471/918] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 6 01:17:44 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:17:44.858421 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e712df3e-8f03-4c9d-a4cc-70f2997c441d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:44.859310 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e712df3e-8f03-4c9d-a4cc-70f2997c441d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:44.866518 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e712df3e-8f03-4c9d-a4cc-70f2997c441d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:44.867334 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e712df3e-8f03-4c9d-a4cc-70f2997c441d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:44.868112 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e712df3e-8f03-4c9d-a4cc-70f2997c441d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:44.869050 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e712df3e-8f03-4c9d-a4cc-70f2997c441d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:44.869718 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e712df3e-8f03-4c9d-a4cc-70f2997c441d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:44.870367 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e712df3e-8f03-4c9d-a4cc-70f2997c441d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:45.028125 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-e712df3e-8f03-4c9d-a4cc-70f2997c441d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:45.038517 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-e712df3e-8f03-4c9d-a4cc-70f2997c441d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:45.043452 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-e712df3e-8f03-4c9d-a4cc-70f2997c441d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:45.045580 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e712df3e-8f03-4c9d-a4cc-70f2997c441d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1740 microversion: 2.20 time: 0.191727 Sep 06 01:17:45.046454 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 448/919] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:17:44 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1740 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:17:45.192313 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-396a2588-7a55-4171-b46c-f53a755045e5 req-0d3a61cd-17b3-46d4-8f0e-90f7e4cfa174 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "590890af-37ec-4cde-b2f7-0b20cc31b43d", "tag": "c382089c-3c7e-40e3-825b-3469de858075"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:17:45.207209 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-396a2588-7a55-4171-b46c-f53a755045e5 req-0d3a61cd-17b3-46d4-8f0e-90f7e4cfa174 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:45.208625 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-396a2588-7a55-4171-b46c-f53a755045e5 req-0d3a61cd-17b3-46d4-8f0e-90f7e4cfa174 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:45.209367 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-396a2588-7a55-4171-b46c-f53a755045e5 req-0d3a61cd-17b3-46d4-8f0e-90f7e4cfa174 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:45.224399 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.compute.server_external_events [req-396a2588-7a55-4171-b46c-f53a755045e5 req-0d3a61cd-17b3-46d4-8f0e-90f7e4cfa174 service nova] Creating event network-changed:c382089c-3c7e-40e3-825b-3469de858075 for instance 590890af-37ec-4cde-b2f7-0b20cc31b43d on hv-cinder-84773 Sep 06 01:17:45.230573 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [req-396a2588-7a55-4171-b46c-f53a755045e5 req-0d3a61cd-17b3-46d4-8f0e-90f7e4cfa174 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041986 Sep 06 01:17:45.231664 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 472/920] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:17:45.673599 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-88242e0f-d73c-4977-9f39-33cd2fb1ee0e tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:45.675891 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-88242e0f-d73c-4977-9f39-33cd2fb1ee0e tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:45.683180 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88242e0f-d73c-4977-9f39-33cd2fb1ee0e tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:45.684008 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88242e0f-d73c-4977-9f39-33cd2fb1ee0e tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:45.684734 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88242e0f-d73c-4977-9f39-33cd2fb1ee0e tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:45.685602 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88242e0f-d73c-4977-9f39-33cd2fb1ee0e tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:45.686221 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88242e0f-d73c-4977-9f39-33cd2fb1ee0e tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:45.686872 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88242e0f-d73c-4977-9f39-33cd2fb1ee0e tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:45.725163 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-88242e0f-d73c-4977-9f39-33cd2fb1ee0e tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055775 Sep 06 01:17:45.732275 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 449/921] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 6 01:17:45 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:17:46.074745 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-801e2ded-9e9d-4226-b259-eabd385f3b15 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:46.075536 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-801e2ded-9e9d-4226-b259-eabd385f3b15 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:46.083935 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-801e2ded-9e9d-4226-b259-eabd385f3b15 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:46.084418 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-801e2ded-9e9d-4226-b259-eabd385f3b15 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:46.084852 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-801e2ded-9e9d-4226-b259-eabd385f3b15 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:46.085548 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-801e2ded-9e9d-4226-b259-eabd385f3b15 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:46.085995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-801e2ded-9e9d-4226-b259-eabd385f3b15 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:46.086422 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-801e2ded-9e9d-4226-b259-eabd385f3b15 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:46.218598 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-801e2ded-9e9d-4226-b259-eabd385f3b15 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:46.226730 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-801e2ded-9e9d-4226-b259-eabd385f3b15 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:46.228206 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-801e2ded-9e9d-4226-b259-eabd385f3b15 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:46.229379 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-801e2ded-9e9d-4226-b259-eabd385f3b15 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1740 microversion: 2.20 time: 0.159616 Sep 06 01:17:46.229932 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 473/922] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:17:46 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1740 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:17:46.670797 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1e777c75-59fa-4b80-8364-99fa04058739 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:46.672051 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1e777c75-59fa-4b80-8364-99fa04058739 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: 35b05aea-d090-4dfc-ac48-250f71e9da06] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:46.678882 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e777c75-59fa-4b80-8364-99fa04058739 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:46.679509 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e777c75-59fa-4b80-8364-99fa04058739 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:46.679947 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e777c75-59fa-4b80-8364-99fa04058739 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:46.680745 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e777c75-59fa-4b80-8364-99fa04058739 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:46.681302 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e777c75-59fa-4b80-8364-99fa04058739 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:46.682042 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e777c75-59fa-4b80-8364-99fa04058739 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:46.710792 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1e777c75-59fa-4b80-8364-99fa04058739 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06/ips" status: 200 len: 149 microversion: 2.1 time: 0.044514 Sep 06 01:17:46.711623 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 450/923] 10.222.0.23 () {58 vars in 1248 bytes} [Tue Sep 6 01:17:46 2022] GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06/ips => generated 149 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:17:46.738758 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-d520a048-c2e3-4a3d-9c2c-abb34d36b31f tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:46.741473 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-d520a048-c2e3-4a3d-9c2c-abb34d36b31f tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:46.748080 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d520a048-c2e3-4a3d-9c2c-abb34d36b31f tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:46.748830 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d520a048-c2e3-4a3d-9c2c-abb34d36b31f tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:46.749429 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d520a048-c2e3-4a3d-9c2c-abb34d36b31f tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:46.750307 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d520a048-c2e3-4a3d-9c2c-abb34d36b31f tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:46.750758 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d520a048-c2e3-4a3d-9c2c-abb34d36b31f tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:46.751183 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d520a048-c2e3-4a3d-9c2c-abb34d36b31f tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:46.782612 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-d520a048-c2e3-4a3d-9c2c-abb34d36b31f tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047805 Sep 06 01:17:46.783192 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 474/924] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 6 01:17:46 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 01:17:46.797189 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-da250db9-cf1e-4967-a5ef-2ba26f457016 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:46.797683 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-da250db9-cf1e-4967-a5ef-2ba26f457016 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:46.804372 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da250db9-cf1e-4967-a5ef-2ba26f457016 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:46.804876 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da250db9-cf1e-4967-a5ef-2ba26f457016 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:46.805545 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da250db9-cf1e-4967-a5ef-2ba26f457016 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:46.806320 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da250db9-cf1e-4967-a5ef-2ba26f457016 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:46.806805 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da250db9-cf1e-4967-a5ef-2ba26f457016 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:46.807233 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da250db9-cf1e-4967-a5ef-2ba26f457016 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:46.892402 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-da250db9-cf1e-4967-a5ef-2ba26f457016 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] HTTP exception thrown: Instance 590890af-37ec-4cde-b2f7-0b20cc31b43d is not attached to volume 0501b5ca-12b9-4092-acee-db360247b463 Sep 06 01:17:46.894780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-da250db9-cf1e-4967-a5ef-2ba26f457016 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Request method failure captured: Sep 06 01:17:46.894780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d/os-volume_attachments/0501b5ca-12b9-4092-acee-db360247b463 HTTP/1.1 Sep 06 01:17:46.894780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept: application/json Sep 06 01:17:46.894780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept-Encoding: identity Sep 06 01:17:46.894780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Connection: close Sep 06 01:17:46.894780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Length: 0 Sep 06 01:17:46.894780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Type: application/json Sep 06 01:17:46.894780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Host: 10.222.0.23 Sep 06 01:17:46.894780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Openstack-System-Scope: None Sep 06 01:17:46.894780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Sep 06 01:17:46.894780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjFp73jb1NqPkHJ4F1BLmhXw6rz4-B8ekVKyVRdWpUw_cFPUupYMq501ifY4YsufzR6fNg7v_ppPzq-h22B1IMyVuP3vaJReVYPQHt5t07N4XQ2bPpH4tvnFzv0CNXPl3IAqSGOEfE2_9K4DQRno1bfYNpGOcKRTXiEQ5H0O95NP-g9k0 Sep 06 01:17:46.894780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Id: None Sep 06 01:17:46.894780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Name: None Sep 06 01:17:46.894780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Identity-Status: Confirmed Sep 06 01:17:46.894780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Is-Admin-Project: True Sep 06 01:17:46.894780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Id: default Sep 06 01:17:46.894780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Name: Default Sep 06 01:17:46.894780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Id: 25d31e6f0604458f8b9a36e2de86ff1f Sep 06 01:17:46.894780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Name: tempest-TestMinimumBasicScenario-1244514133 Sep 06 01:17:46.894780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Role: reader,member Sep 06 01:17:46.894780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Roles: reader,member Sep 06 01:17:46.896243 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/25d31e6f0604458f8b9a36e2de86ff1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/25d31e6f0604458f8b9a36e2de86ff1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_25d31e6f0604458f8b9a36e2de86ff1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/25d31e6f0604458f8b9a36e2de86ff1f"}]}] Sep 06 01:17:46.896243 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant: tempest-TestMinimumBasicScenario-1244514133 Sep 06 01:17:46.896243 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Id: 25d31e6f0604458f8b9a36e2de86ff1f Sep 06 01:17:46.896243 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1244514133 Sep 06 01:17:46.896243 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User: tempest-TestMinimumBasicScenario-1244514133-project Sep 06 01:17:46.896243 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Id: default Sep 06 01:17:46.896243 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Name: Default Sep 06 01:17:46.896243 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Id: 18c5c95fde3646409d542da0ff274883 Sep 06 01:17:46.896243 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Name: tempest-TestMinimumBasicScenario-1244514133-project Sep 06 01:17:46.896243 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: method: > Sep 06 01:17:46.896243 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: exception: Instance 590890af-37ec-4cde-b2f7-0b20cc31b43d is not attached to volume 0501b5ca-12b9-4092-acee-db360247b463 Sep 06 01:17:46.900401 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: action_args: {'server_id': '590890af-37ec-4cde-b2f7-0b20cc31b43d', 'id': '0501b5ca-12b9-4092-acee-db360247b463'} Sep 06 01:17:46.900401 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:17:46.900401 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:17:46.900401 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 06 01:17:46.900401 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 06 01:17:46.900401 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 01:17:46.900401 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 01:17:46.900401 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 06 01:17:46.900401 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 06 01:17:46.900401 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0501b5ca-12b9-4092-acee-db360247b463. Sep 06 01:17:46.900401 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:17:46.900401 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:17:46.900401 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:17:46.900401 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:17:46.900401 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:17:46.900401 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:17:46.900401 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:17:46.900401 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:17:46.900401 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:17:46.901589 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:17:46.901589 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 06 01:17:46.901589 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 06 01:17:46.901589 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 590890af-37ec-4cde-b2f7-0b20cc31b43d is not attached to volume 0501b5ca-12b9-4092-acee-db360247b463 Sep 06 01:17:46.901589 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:17:46.901589 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:17:46.901589 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:17:46.901589 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:17:46.901589 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:17:46.901589 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:17:46.901589 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:17:46.901589 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:17:46.901589 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 590890af-37ec-4cde-b2f7-0b20cc31b43d is not attached to volume 0501b5ca-12b9-4092-acee-db360247b463 Sep 06 01:17:46.901589 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:17:46.901589 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-da250db9-cf1e-4967-a5ef-2ba26f457016 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Returning 404 to user: Instance 590890af-37ec-4cde-b2f7-0b20cc31b43d is not attached to volume 0501b5ca-12b9-4092-acee-db360247b463 {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:17:46.902639 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-da250db9-cf1e-4967-a5ef-2ba26f457016 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "DELETE /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d/os-volume_attachments/0501b5ca-12b9-4092-acee-db360247b463" status: 404 len: 154 microversion: 2.1 time: 0.105891 Sep 06 01:17:46.902639 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 451/925] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Sep 6 01:17:46 2022] DELETE /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d/os-volume_attachments/0501b5ca-12b9-4092-acee-db360247b463 => generated 154 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 01:17:47.255569 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-1178c6ac-6c26-4439-b525-e3b5d3c23c6c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:47.256516 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-1178c6ac-6c26-4439-b525-e3b5d3c23c6c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:47.269536 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1178c6ac-6c26-4439-b525-e3b5d3c23c6c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:47.270218 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1178c6ac-6c26-4439-b525-e3b5d3c23c6c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:47.271150 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1178c6ac-6c26-4439-b525-e3b5d3c23c6c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:47.272265 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1178c6ac-6c26-4439-b525-e3b5d3c23c6c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:47.272555 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1178c6ac-6c26-4439-b525-e3b5d3c23c6c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:47.272981 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1178c6ac-6c26-4439-b525-e3b5d3c23c6c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:47.426237 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-1178c6ac-6c26-4439-b525-e3b5d3c23c6c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:47.434385 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-1178c6ac-6c26-4439-b525-e3b5d3c23c6c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:47.436166 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-1178c6ac-6c26-4439-b525-e3b5d3c23c6c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:47.437545 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-1178c6ac-6c26-4439-b525-e3b5d3c23c6c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1722 microversion: 2.20 time: 0.186660 Sep 06 01:17:47.438320 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 475/926] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:17:47 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:17:48.100306 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-12895984-a6fd-4cb0-b846-4ad3786d5e5a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0fe20465-8966-4dac-ba9a-8b17ffae90a7"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:17:48.102677 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-12895984-a6fd-4cb0-b846-4ad3786d5e5a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: 35b05aea-d090-4dfc-ac48-250f71e9da06] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:48.110232 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-5cf8aa28-eb4e-4857-af27-1be84665f8c9 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:48.110810 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-5cf8aa28-eb4e-4857-af27-1be84665f8c9 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:48.111424 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-12895984-a6fd-4cb0-b846-4ad3786d5e5a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:48.112133 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-12895984-a6fd-4cb0-b846-4ad3786d5e5a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:48.112648 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-12895984-a6fd-4cb0-b846-4ad3786d5e5a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:48.113112 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:17:48.113566 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-12895984-a6fd-4cb0-b846-4ad3786d5e5a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:48.114087 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-12895984-a6fd-4cb0-b846-4ad3786d5e5a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:48.115235 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-12895984-a6fd-4cb0-b846-4ad3786d5e5a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:48.119043 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5cf8aa28-eb4e-4857-af27-1be84665f8c9 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:48.119528 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5cf8aa28-eb4e-4857-af27-1be84665f8c9 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:48.119998 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5cf8aa28-eb4e-4857-af27-1be84665f8c9 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:48.120694 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5cf8aa28-eb4e-4857-af27-1be84665f8c9 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:48.121148 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5cf8aa28-eb4e-4857-af27-1be84665f8c9 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:48.121573 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5cf8aa28-eb4e-4857-af27-1be84665f8c9 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:48.147577 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-5cf8aa28-eb4e-4857-af27-1be84665f8c9 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Going to try to terminate instance {{(pid=120580) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 01:17:48.220854 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-5cf8aa28-eb4e-4857-af27-1be84665f8c9 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "DELETE /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 204 len: 0 microversion: 2.1 time: 0.114254 Sep 06 01:17:48.221439 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 476/927] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 6 01:17:48 2022] DELETE /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 01:17:48.230344 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-28da96ad-ecd5-4322-8c09-0ef68879d923 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:48.231035 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-28da96ad-ecd5-4322-8c09-0ef68879d923 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:48.236577 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-28da96ad-ecd5-4322-8c09-0ef68879d923 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:48.237052 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-28da96ad-ecd5-4322-8c09-0ef68879d923 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:48.237485 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-28da96ad-ecd5-4322-8c09-0ef68879d923 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:48.238162 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-28da96ad-ecd5-4322-8c09-0ef68879d923 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:48.238611 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-28da96ad-ecd5-4322-8c09-0ef68879d923 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:48.239033 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-28da96ad-ecd5-4322-8c09-0ef68879d923 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:48.368190 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-28da96ad-ecd5-4322-8c09-0ef68879d923 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:48.377231 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-28da96ad-ecd5-4322-8c09-0ef68879d923 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1555 microversion: 2.1 time: 0.150856 Sep 06 01:17:48.377788 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 477/928] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:48 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:17:48.470984 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-9e913b43-3699-44ea-95a2-e29746c95e39 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:48.471589 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-9e913b43-3699-44ea-95a2-e29746c95e39 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:48.477405 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9e913b43-3699-44ea-95a2-e29746c95e39 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:48.477883 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9e913b43-3699-44ea-95a2-e29746c95e39 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:48.478319 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9e913b43-3699-44ea-95a2-e29746c95e39 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:48.479002 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9e913b43-3699-44ea-95a2-e29746c95e39 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:48.479453 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9e913b43-3699-44ea-95a2-e29746c95e39 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:48.479907 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9e913b43-3699-44ea-95a2-e29746c95e39 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:48.605458 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-9e913b43-3699-44ea-95a2-e29746c95e39 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:48.613493 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-9e913b43-3699-44ea-95a2-e29746c95e39 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:48.614941 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-9e913b43-3699-44ea-95a2-e29746c95e39 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:48.616131 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-9e913b43-3699-44ea-95a2-e29746c95e39 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1722 microversion: 2.20 time: 0.148780 Sep 06 01:17:48.616681 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 478/929] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:17:48 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:17:49.171796 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-d91096e9-a60b-4fd1-ba41-f45fed5b2f17 req-41f3fe00-7929-4e51-b56b-0010f06aff35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "366390df-669b-48b1-b741-56d5fdd64441", "name": "network-vif-unplugged", "status": "completed", "tag": "703a4acd-427c-4fd4-bf73-f445a5bcac26"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:17:49.181821 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-d91096e9-a60b-4fd1-ba41-f45fed5b2f17 req-41f3fe00-7929-4e51-b56b-0010f06aff35 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:49.182347 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-d91096e9-a60b-4fd1-ba41-f45fed5b2f17 req-41f3fe00-7929-4e51-b56b-0010f06aff35 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:49.182779 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-d91096e9-a60b-4fd1-ba41-f45fed5b2f17 req-41f3fe00-7929-4e51-b56b-0010f06aff35 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:49.194384 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.compute.server_external_events [req-d91096e9-a60b-4fd1-ba41-f45fed5b2f17 req-41f3fe00-7929-4e51-b56b-0010f06aff35 service nova] Creating event network-vif-unplugged:703a4acd-427c-4fd4-bf73-f445a5bcac26 for instance 366390df-669b-48b1-b741-56d5fdd64441 on hv-cinder-84773 Sep 06 01:17:49.199135 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [req-d91096e9-a60b-4fd1-ba41-f45fed5b2f17 req-41f3fe00-7929-4e51-b56b-0010f06aff35 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031351 Sep 06 01:17:49.199740 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 479/930] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 01:17:49.402419 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-39fcada1-e7a0-45e1-8896-c7045d9b88d1 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:49.403055 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-39fcada1-e7a0-45e1-8896-c7045d9b88d1 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:49.410166 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-39fcada1-e7a0-45e1-8896-c7045d9b88d1 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:49.410646 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-39fcada1-e7a0-45e1-8896-c7045d9b88d1 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:49.411575 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-39fcada1-e7a0-45e1-8896-c7045d9b88d1 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:49.412290 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-39fcada1-e7a0-45e1-8896-c7045d9b88d1 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:49.412739 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-39fcada1-e7a0-45e1-8896-c7045d9b88d1 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:49.413159 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-39fcada1-e7a0-45e1-8896-c7045d9b88d1 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:49.544413 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-39fcada1-e7a0-45e1-8896-c7045d9b88d1 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:49.552219 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-39fcada1-e7a0-45e1-8896-c7045d9b88d1 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1555 microversion: 2.1 time: 0.154680 Sep 06 01:17:49.552780 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 480/931] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:49 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:17:49.641184 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-5136856d-b420-45b5-914e-97770ef328da tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:49.641826 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-5136856d-b420-45b5-914e-97770ef328da tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:49.648716 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5136856d-b420-45b5-914e-97770ef328da tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:49.649196 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5136856d-b420-45b5-914e-97770ef328da tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:49.649626 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5136856d-b420-45b5-914e-97770ef328da tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:49.650342 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5136856d-b420-45b5-914e-97770ef328da tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:49.650978 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5136856d-b420-45b5-914e-97770ef328da tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:49.651398 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-5136856d-b420-45b5-914e-97770ef328da tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:49.778231 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-5136856d-b420-45b5-914e-97770ef328da tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:49.786920 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-5136856d-b420-45b5-914e-97770ef328da tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:49.788405 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-5136856d-b420-45b5-914e-97770ef328da tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:49.789566 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-5136856d-b420-45b5-914e-97770ef328da tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1722 microversion: 2.20 time: 0.152279 Sep 06 01:17:49.790125 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 481/932] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:17:49 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:17:50.574644 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-4259c757-b8a7-4065-9585-eee6cacb3a0b tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:50.575303 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-4259c757-b8a7-4065-9585-eee6cacb3a0b tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:50.581625 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4259c757-b8a7-4065-9585-eee6cacb3a0b tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:50.582104 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4259c757-b8a7-4065-9585-eee6cacb3a0b tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:50.582535 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4259c757-b8a7-4065-9585-eee6cacb3a0b tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:50.583293 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4259c757-b8a7-4065-9585-eee6cacb3a0b tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:50.583813 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4259c757-b8a7-4065-9585-eee6cacb3a0b tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:50.584234 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4259c757-b8a7-4065-9585-eee6cacb3a0b tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:50.713973 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-4259c757-b8a7-4065-9585-eee6cacb3a0b tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:50.721774 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-4259c757-b8a7-4065-9585-eee6cacb3a0b tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1555 microversion: 2.1 time: 0.151035 Sep 06 01:17:50.722339 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 482/933] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:50 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:17:50.814406 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-a5a6f34b-d69a-4abc-a357-732986750a0b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:50.815008 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-a5a6f34b-d69a-4abc-a357-732986750a0b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:50.820879 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a5a6f34b-d69a-4abc-a357-732986750a0b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:50.821358 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a5a6f34b-d69a-4abc-a357-732986750a0b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:50.821790 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a5a6f34b-d69a-4abc-a357-732986750a0b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:50.822470 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a5a6f34b-d69a-4abc-a357-732986750a0b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:50.822919 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a5a6f34b-d69a-4abc-a357-732986750a0b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:50.823339 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a5a6f34b-d69a-4abc-a357-732986750a0b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:50.948487 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-a5a6f34b-d69a-4abc-a357-732986750a0b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:50.956350 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-a5a6f34b-d69a-4abc-a357-732986750a0b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:50.957781 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-a5a6f34b-d69a-4abc-a357-732986750a0b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:50.958990 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-a5a6f34b-d69a-4abc-a357-732986750a0b tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1722 microversion: 2.20 time: 0.148334 Sep 06 01:17:50.959536 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 483/934] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:17:50 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:17:51.123048 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-12895984-a6fd-4cb0-b846-4ad3786d5e5a tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "POST /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.026628 Sep 06 01:17:51.123650 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 452/935] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Sep 6 01:17:48 2022] POST /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06/os-volume_attachments => generated 194 bytes in 3028 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:17:51.746129 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-e4951810-3a40-43d2-b8d1-3500d5037fdc tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:51.746883 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-e4951810-3a40-43d2-b8d1-3500d5037fdc tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:51.761817 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e4951810-3a40-43d2-b8d1-3500d5037fdc tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:51.762541 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e4951810-3a40-43d2-b8d1-3500d5037fdc tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:51.763067 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e4951810-3a40-43d2-b8d1-3500d5037fdc tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:51.763939 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e4951810-3a40-43d2-b8d1-3500d5037fdc tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:51.764470 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e4951810-3a40-43d2-b8d1-3500d5037fdc tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:51.768227 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e4951810-3a40-43d2-b8d1-3500d5037fdc tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:51.827874 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-a713cad3-3915-4a71-ae6a-3e9d0847e504 req-b749437f-3e8a-40c8-9c8a-373e11cdb599 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "590890af-37ec-4cde-b2f7-0b20cc31b43d", "name": "network-vif-deleted", "tag": "c382089c-3c7e-40e3-825b-3469de858075"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:17:51.841791 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-e4951810-3a40-43d2-b8d1-3500d5037fdc tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5c95fde3646409d542da0ff274883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d31e6f0604458f8b9a36e2de86ff1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:51.842546 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:17:51.850772 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-e4951810-3a40-43d2-b8d1-3500d5037fdc tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 200 len: 1513 microversion: 2.1 time: 0.108472 Sep 06 01:17:51.855787 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 484/936] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:51 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 1513 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:17:51.855952 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a713cad3-3915-4a71-ae6a-3e9d0847e504 req-b749437f-3e8a-40c8-9c8a-373e11cdb599 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:51.855952 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a713cad3-3915-4a71-ae6a-3e9d0847e504 req-b749437f-3e8a-40c8-9c8a-373e11cdb599 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:51.855952 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a713cad3-3915-4a71-ae6a-3e9d0847e504 req-b749437f-3e8a-40c8-9c8a-373e11cdb599 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:51.866580 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-a713cad3-3915-4a71-ae6a-3e9d0847e504 req-b749437f-3e8a-40c8-9c8a-373e11cdb599 service nova] Creating event network-vif-deleted:c382089c-3c7e-40e3-825b-3469de858075 for instance 590890af-37ec-4cde-b2f7-0b20cc31b43d on hv-cinder-84773 Sep 06 01:17:51.871434 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-a713cad3-3915-4a71-ae6a-3e9d0847e504 req-b749437f-3e8a-40c8-9c8a-373e11cdb599 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049080 Sep 06 01:17:51.872385 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 453/937] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:17:51.984610 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-00600342-1f56-41a5-a61a-503d882db7e5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:51.985215 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-00600342-1f56-41a5-a61a-503d882db7e5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:51.991132 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-00600342-1f56-41a5-a61a-503d882db7e5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:51.991612 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-00600342-1f56-41a5-a61a-503d882db7e5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:51.992070 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-00600342-1f56-41a5-a61a-503d882db7e5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:51.992758 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-00600342-1f56-41a5-a61a-503d882db7e5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:51.993291 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-00600342-1f56-41a5-a61a-503d882db7e5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:51.993612 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-00600342-1f56-41a5-a61a-503d882db7e5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:52.131347 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-00600342-1f56-41a5-a61a-503d882db7e5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:52.139683 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-00600342-1f56-41a5-a61a-503d882db7e5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:52.141174 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-00600342-1f56-41a5-a61a-503d882db7e5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:52.142347 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-00600342-1f56-41a5-a61a-503d882db7e5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1665 microversion: 2.20 time: 0.161565 Sep 06 01:17:52.142890 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 485/938] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:17:51 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1665 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:17:52.168247 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6448cef8-263f-40b7-a8e3-8e4be3ae227f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b3745c3d-312d-409c-adb6-59d5d05cb0ed"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:17:52.170642 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6448cef8-263f-40b7-a8e3-8e4be3ae227f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:52.177562 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6448cef8-263f-40b7-a8e3-8e4be3ae227f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:52.178060 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6448cef8-263f-40b7-a8e3-8e4be3ae227f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:52.178482 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6448cef8-263f-40b7-a8e3-8e4be3ae227f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:52.179179 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6448cef8-263f-40b7-a8e3-8e4be3ae227f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:52.179627 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6448cef8-263f-40b7-a8e3-8e4be3ae227f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:52.180074 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6448cef8-263f-40b7-a8e3-8e4be3ae227f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:52.450288 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=5,nova_cell1:UPDATE=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:17:52.456089 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6448cef8-263f-40b7-a8e3-8e4be3ae227f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "POST /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.292498 Sep 06 01:17:52.456686 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 454/939] 10.222.0.23 () {62 vars in 1364 bytes} [Tue Sep 6 01:17:52 2022] POST /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441/os-volume_attachments => generated 188 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 01:17:52.587281 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-10d6ed62-3639-49ab-be2d-8236761521ff tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:52.587792 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-10d6ed62-3639-49ab-be2d-8236761521ff tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:52.593773 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-10d6ed62-3639-49ab-be2d-8236761521ff tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:52.594258 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-10d6ed62-3639-49ab-be2d-8236761521ff tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:52.594688 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-10d6ed62-3639-49ab-be2d-8236761521ff tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:52.595401 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-10d6ed62-3639-49ab-be2d-8236761521ff tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:52.595881 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-10d6ed62-3639-49ab-be2d-8236761521ff tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:52.596302 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-10d6ed62-3639-49ab-be2d-8236761521ff tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:52.697600 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:17:52.855650 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-10d6ed62-3639-49ab-be2d-8236761521ff tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "DELETE /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441/os-volume_attachments/b3745c3d-312d-409c-adb6-59d5d05cb0ed" status: 202 len: 0 microversion: 2.20 time: 0.276530 Sep 06 01:17:52.857008 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 486/940] 10.222.0.23 () {60 vars in 1457 bytes} [Tue Sep 6 01:17:52 2022] DELETE /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441/os-volume_attachments/b3745c3d-312d-409c-adb6-59d5d05cb0ed => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 01:17:52.879331 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6b3950b7-721a-4124-9fca-275a30154b40 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:52.879331 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6b3950b7-721a-4124-9fca-275a30154b40 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] [instance: 590890af-37ec-4cde-b2f7-0b20cc31b43d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:52.887424 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b3950b7-721a-4124-9fca-275a30154b40 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:52.888026 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b3950b7-721a-4124-9fca-275a30154b40 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:52.888449 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b3950b7-721a-4124-9fca-275a30154b40 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:52.889146 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b3950b7-721a-4124-9fca-275a30154b40 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:52.889620 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b3950b7-721a-4124-9fca-275a30154b40 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:52.890046 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b3950b7-721a-4124-9fca-275a30154b40 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:52.903594 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-6b3950b7-721a-4124-9fca-275a30154b40 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] HTTP exception thrown: Instance 590890af-37ec-4cde-b2f7-0b20cc31b43d could not be found. Sep 06 01:17:52.911675 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6b3950b7-721a-4124-9fca-275a30154b40 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Request method failure captured: Sep 06 01:17:52.911675 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d HTTP/1.1 Sep 06 01:17:52.911675 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept: application/json Sep 06 01:17:52.911675 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept-Encoding: identity Sep 06 01:17:52.911675 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Connection: close Sep 06 01:17:52.911675 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Length: 0 Sep 06 01:17:52.911675 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Type: application/json Sep 06 01:17:52.911675 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Host: 10.222.0.23 Sep 06 01:17:52.911675 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Openstack-System-Scope: None Sep 06 01:17:52.911675 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Sep 06 01:17:52.911675 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjFp73jb1NqPkHJ4F1BLmhXw6rz4-B8ekVKyVRdWpUw_cFPUupYMq501ifY4YsufzR6fNg7v_ppPzq-h22B1IMyVuP3vaJReVYPQHt5t07N4XQ2bPpH4tvnFzv0CNXPl3IAqSGOEfE2_9K4DQRno1bfYNpGOcKRTXiEQ5H0O95NP-g9k0 Sep 06 01:17:52.911675 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Id: None Sep 06 01:17:52.911675 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Name: None Sep 06 01:17:52.911675 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Identity-Status: Confirmed Sep 06 01:17:52.911675 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Is-Admin-Project: True Sep 06 01:17:52.911675 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Id: default Sep 06 01:17:52.911675 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Name: Default Sep 06 01:17:52.911675 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Id: 25d31e6f0604458f8b9a36e2de86ff1f Sep 06 01:17:52.911675 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Name: tempest-TestMinimumBasicScenario-1244514133 Sep 06 01:17:52.911675 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Role: reader,member Sep 06 01:17:52.911675 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Roles: reader,member Sep 06 01:17:52.913329 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/25d31e6f0604458f8b9a36e2de86ff1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/25d31e6f0604458f8b9a36e2de86ff1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_25d31e6f0604458f8b9a36e2de86ff1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/25d31e6f0604458f8b9a36e2de86ff1f"}]}] Sep 06 01:17:52.913329 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant: tempest-TestMinimumBasicScenario-1244514133 Sep 06 01:17:52.913329 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Id: 25d31e6f0604458f8b9a36e2de86ff1f Sep 06 01:17:52.913329 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1244514133 Sep 06 01:17:52.913329 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User: tempest-TestMinimumBasicScenario-1244514133-project Sep 06 01:17:52.913329 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Id: default Sep 06 01:17:52.913329 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Name: Default Sep 06 01:17:52.913329 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Id: 18c5c95fde3646409d542da0ff274883 Sep 06 01:17:52.913329 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Name: tempest-TestMinimumBasicScenario-1244514133-project Sep 06 01:17:52.913329 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: method: > Sep 06 01:17:52.913329 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: exception: Instance 590890af-37ec-4cde-b2f7-0b20cc31b43d could not be found. Sep 06 01:17:52.913329 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: action_args: {'id': '590890af-37ec-4cde-b2f7-0b20cc31b43d'} Sep 06 01:17:52.914373 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:17:52.914373 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:17:52.914373 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 01:17:52.914373 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 01:17:52.914373 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 01:17:52.914373 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 01:17:52.914373 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 01:17:52.914373 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 01:17:52.914373 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 01:17:52.914373 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 01:17:52.914373 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 590890af-37ec-4cde-b2f7-0b20cc31b43d could not be found. Sep 06 01:17:52.914373 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:17:52.914373 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:17:52.914373 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:17:52.914373 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:17:52.914373 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:17:52.914373 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:17:52.914373 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:17:52.914373 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:17:52.914373 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:17:52.915742 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:17:52.915742 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 01:17:52.915742 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 01:17:52.915742 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 01:17:52.915742 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 01:17:52.915742 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 01:17:52.915742 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:17:52.915742 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 590890af-37ec-4cde-b2f7-0b20cc31b43d could not be found. Sep 06 01:17:52.915742 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:17:52.915742 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:17:52.915742 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:17:52.915742 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:17:52.915742 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:17:52.915742 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:17:52.915742 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:17:52.915742 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:17:52.915742 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 590890af-37ec-4cde-b2f7-0b20cc31b43d could not be found. Sep 06 01:17:52.915742 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:17:52.918407 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6b3950b7-721a-4124-9fca-275a30154b40 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Returning 404 to user: Instance 590890af-37ec-4cde-b2f7-0b20cc31b43d could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:17:52.918407 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6b3950b7-721a-4124-9fca-275a30154b40 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d" status: 404 len: 111 microversion: 2.1 time: 0.043762 Sep 06 01:17:52.918407 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 455/941] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:17:52 2022] GET /compute/v2.1/servers/590890af-37ec-4cde-b2f7-0b20cc31b43d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 01:17:52.923110 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-7fa77069-9337-4835-9342-85ffa931ab76 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] Calling method '.version_select at 0x7fb06e115700>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:52.925748 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3424ca7c-3367-43e6-9252-c379ed26cd84 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:17:52.926424 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3424ca7c-3367-43e6-9252-c379ed26cd84 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:52.932978 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3424ca7c-3367-43e6-9252-c379ed26cd84 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:52.933563 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3424ca7c-3367-43e6-9252-c379ed26cd84 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:52.933903 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3424ca7c-3367-43e6-9252-c379ed26cd84 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:52.934596 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3424ca7c-3367-43e6-9252-c379ed26cd84 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:52.935058 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3424ca7c-3367-43e6-9252-c379ed26cd84 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:52.935491 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3424ca7c-3367-43e6-9252-c379ed26cd84 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:52.943468 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-7fa77069-9337-4835-9342-85ffa931ab76 tempest-TestMinimumBasicScenario-1244514133 tempest-TestMinimumBasicScenario-1244514133-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1401040889" status: 202 len: 0 microversion: 2.1 time: 0.024397 Sep 06 01:17:52.944164 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 487/942] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Sep 6 01:17:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1401040889 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 01:17:52.966680 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3424ca7c-3367-43e6-9252-c379ed26cd84 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120581) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 06 01:17:53.034775 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3424ca7c-3367-43e6-9252-c379ed26cd84 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "POST /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441/action" status: 202 len: 0 microversion: 2.20 time: 0.113002 Sep 06 01:17:53.037322 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 456/943] 10.222.0.23 () {62 vars in 1319 bytes} [Tue Sep 6 01:17:52 2022] POST /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 01:17:53.046102 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-b7074373-c150-40b7-88e0-93d519a7d543 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:53.046721 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-b7074373-c150-40b7-88e0-93d519a7d543 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:53.054348 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b7074373-c150-40b7-88e0-93d519a7d543 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:53.054824 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b7074373-c150-40b7-88e0-93d519a7d543 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:53.055460 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b7074373-c150-40b7-88e0-93d519a7d543 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:53.056200 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b7074373-c150-40b7-88e0-93d519a7d543 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:53.056841 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b7074373-c150-40b7-88e0-93d519a7d543 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:53.057257 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b7074373-c150-40b7-88e0-93d519a7d543 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:53.243845 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-b7074373-c150-40b7-88e0-93d519a7d543 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:53.252350 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-b7074373-c150-40b7-88e0-93d519a7d543 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:53.253785 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-b7074373-c150-40b7-88e0-93d519a7d543 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:53.255069 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-b7074373-c150-40b7-88e0-93d519a7d543 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1673 microversion: 2.20 time: 0.212996 Sep 06 01:17:53.255630 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 488/944] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:17:53 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1673 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:17:54.282552 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-42fab638-6fde-40b6-8ba6-82f52bf30330 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:54.283703 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-42fab638-6fde-40b6-8ba6-82f52bf30330 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:54.290086 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42fab638-6fde-40b6-8ba6-82f52bf30330 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:54.290582 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42fab638-6fde-40b6-8ba6-82f52bf30330 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:54.291275 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42fab638-6fde-40b6-8ba6-82f52bf30330 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:54.292148 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42fab638-6fde-40b6-8ba6-82f52bf30330 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:54.292614 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42fab638-6fde-40b6-8ba6-82f52bf30330 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:54.293046 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42fab638-6fde-40b6-8ba6-82f52bf30330 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:54.465296 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-42fab638-6fde-40b6-8ba6-82f52bf30330 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:54.474364 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-42fab638-6fde-40b6-8ba6-82f52bf30330 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:54.476007 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-42fab638-6fde-40b6-8ba6-82f52bf30330 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:54.477322 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-42fab638-6fde-40b6-8ba6-82f52bf30330 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1675 microversion: 2.20 time: 0.200411 Sep 06 01:17:54.477870 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 457/945] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:17:54 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1675 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:17:55.505383 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-cab23a8b-0b53-4b06-a343-3f94d26c1068 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:55.507245 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-cab23a8b-0b53-4b06-a343-3f94d26c1068 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:55.516053 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cab23a8b-0b53-4b06-a343-3f94d26c1068 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:55.516909 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cab23a8b-0b53-4b06-a343-3f94d26c1068 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:55.517532 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cab23a8b-0b53-4b06-a343-3f94d26c1068 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:55.519178 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cab23a8b-0b53-4b06-a343-3f94d26c1068 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:55.519855 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cab23a8b-0b53-4b06-a343-3f94d26c1068 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:55.521019 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-cab23a8b-0b53-4b06-a343-3f94d26c1068 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:55.935470 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-cab23a8b-0b53-4b06-a343-3f94d26c1068 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:55.948287 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-cab23a8b-0b53-4b06-a343-3f94d26c1068 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:55.950252 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-cab23a8b-0b53-4b06-a343-3f94d26c1068 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:55.952722 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-cab23a8b-0b53-4b06-a343-3f94d26c1068 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1731 microversion: 2.20 time: 0.451838 Sep 06 01:17:55.953602 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 489/946] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:17:55 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1731 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:17:56.982956 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-22660af2-d0b5-43bf-aa8c-adedc853db3d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:56.983932 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-22660af2-d0b5-43bf-aa8c-adedc853db3d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:56.995557 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22660af2-d0b5-43bf-aa8c-adedc853db3d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:56.999905 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22660af2-d0b5-43bf-aa8c-adedc853db3d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:57.001474 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22660af2-d0b5-43bf-aa8c-adedc853db3d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:57.003785 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22660af2-d0b5-43bf-aa8c-adedc853db3d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:57.004456 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22660af2-d0b5-43bf-aa8c-adedc853db3d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:57.005229 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22660af2-d0b5-43bf-aa8c-adedc853db3d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:57.342159 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-22660af2-d0b5-43bf-aa8c-adedc853db3d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:57.355811 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-22660af2-d0b5-43bf-aa8c-adedc853db3d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:57.357534 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-22660af2-d0b5-43bf-aa8c-adedc853db3d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:57.358710 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-22660af2-d0b5-43bf-aa8c-adedc853db3d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1731 microversion: 2.20 time: 0.383629 Sep 06 01:17:57.359458 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 458/947] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:17:56 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1731 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:17:58.386745 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-edc30327-2937-4966-8b83-765fbac81de1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:58.387373 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-edc30327-2937-4966-8b83-765fbac81de1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:58.395019 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-edc30327-2937-4966-8b83-765fbac81de1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:58.396506 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-edc30327-2937-4966-8b83-765fbac81de1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:58.397156 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-edc30327-2937-4966-8b83-765fbac81de1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:58.398407 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-edc30327-2937-4966-8b83-765fbac81de1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:58.398868 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-edc30327-2937-4966-8b83-765fbac81de1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:58.399301 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-edc30327-2937-4966-8b83-765fbac81de1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:58.719811 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-edc30327-2937-4966-8b83-765fbac81de1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:58.732845 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-edc30327-2937-4966-8b83-765fbac81de1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:58.734326 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-edc30327-2937-4966-8b83-765fbac81de1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:58.735835 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-edc30327-2937-4966-8b83-765fbac81de1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1731 microversion: 2.20 time: 0.353089 Sep 06 01:17:58.747737 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 490/948] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:17:58 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1731 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:17:59.762552 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-95f84ec7-d796-44a6-8ec4-08cecf9f2ecd tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:17:59.763253 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-95f84ec7-d796-44a6-8ec4-08cecf9f2ecd tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:17:59.770000 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95f84ec7-d796-44a6-8ec4-08cecf9f2ecd tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:59.770710 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95f84ec7-d796-44a6-8ec4-08cecf9f2ecd tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:59.771222 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95f84ec7-d796-44a6-8ec4-08cecf9f2ecd tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:59.772091 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95f84ec7-d796-44a6-8ec4-08cecf9f2ecd tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:17:59.772613 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95f84ec7-d796-44a6-8ec4-08cecf9f2ecd tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:17:59.773106 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95f84ec7-d796-44a6-8ec4-08cecf9f2ecd tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:17:59.975729 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-95f84ec7-d796-44a6-8ec4-08cecf9f2ecd tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:59.987335 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-95f84ec7-d796-44a6-8ec4-08cecf9f2ecd tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:59.989666 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-95f84ec7-d796-44a6-8ec4-08cecf9f2ecd tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:17:59.991011 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-95f84ec7-d796-44a6-8ec4-08cecf9f2ecd tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1731 microversion: 2.20 time: 0.232363 Sep 06 01:17:59.991575 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 459/949] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:17:59 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1731 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:18:01.018470 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-f03538fb-e533-4263-a5ce-e129a3575ff5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:01.019700 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-f03538fb-e533-4263-a5ce-e129a3575ff5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:01.028703 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f03538fb-e533-4263-a5ce-e129a3575ff5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:01.040550 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f03538fb-e533-4263-a5ce-e129a3575ff5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:01.041507 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f03538fb-e533-4263-a5ce-e129a3575ff5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:01.042438 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f03538fb-e533-4263-a5ce-e129a3575ff5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:01.042898 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f03538fb-e533-4263-a5ce-e129a3575ff5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:01.043332 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f03538fb-e533-4263-a5ce-e129a3575ff5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:01.220853 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-f03538fb-e533-4263-a5ce-e129a3575ff5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:01.231177 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-f03538fb-e533-4263-a5ce-e129a3575ff5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:01.235789 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-f03538fb-e533-4263-a5ce-e129a3575ff5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:01.237195 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-f03538fb-e533-4263-a5ce-e129a3575ff5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1731 microversion: 2.20 time: 0.222832 Sep 06 01:18:01.237928 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 491/950] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:18:01 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1731 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:18:02.266699 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dcdab21d-10e8-48c3-be0b-066849766bc0 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:02.267308 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-dcdab21d-10e8-48c3-be0b-066849766bc0 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:02.276975 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dcdab21d-10e8-48c3-be0b-066849766bc0 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:02.277393 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dcdab21d-10e8-48c3-be0b-066849766bc0 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:02.277830 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dcdab21d-10e8-48c3-be0b-066849766bc0 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:02.278529 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dcdab21d-10e8-48c3-be0b-066849766bc0 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:02.279011 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dcdab21d-10e8-48c3-be0b-066849766bc0 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:02.279432 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dcdab21d-10e8-48c3-be0b-066849766bc0 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:02.522651 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-dcdab21d-10e8-48c3-be0b-066849766bc0 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:02.545421 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-dcdab21d-10e8-48c3-be0b-066849766bc0 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:02.547222 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-dcdab21d-10e8-48c3-be0b-066849766bc0 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:02.550081 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dcdab21d-10e8-48c3-be0b-066849766bc0 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1731 microversion: 2.20 time: 0.287642 Sep 06 01:18:02.550576 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 460/951] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:18:02 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1731 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:18:03.576441 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-122207e2-c735-4992-9d74-0838cd758c11 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:03.577835 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-122207e2-c735-4992-9d74-0838cd758c11 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:03.591458 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-122207e2-c735-4992-9d74-0838cd758c11 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:03.592651 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-122207e2-c735-4992-9d74-0838cd758c11 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:03.593310 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-122207e2-c735-4992-9d74-0838cd758c11 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:03.594229 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-122207e2-c735-4992-9d74-0838cd758c11 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:03.594878 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-122207e2-c735-4992-9d74-0838cd758c11 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:03.595512 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-122207e2-c735-4992-9d74-0838cd758c11 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:03.776018 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-122207e2-c735-4992-9d74-0838cd758c11 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:03.784905 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-122207e2-c735-4992-9d74-0838cd758c11 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:03.786440 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-122207e2-c735-4992-9d74-0838cd758c11 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:03.787687 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-122207e2-c735-4992-9d74-0838cd758c11 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1731 microversion: 2.20 time: 0.215898 Sep 06 01:18:03.800109 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 492/952] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:18:03 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1731 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:18:04.814662 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d3c8cb2a-310a-4936-be71-3aa7d0b4c245 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:04.815394 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d3c8cb2a-310a-4936-be71-3aa7d0b4c245 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:04.821958 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d3c8cb2a-310a-4936-be71-3aa7d0b4c245 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:04.822434 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d3c8cb2a-310a-4936-be71-3aa7d0b4c245 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:04.822863 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d3c8cb2a-310a-4936-be71-3aa7d0b4c245 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:04.823543 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d3c8cb2a-310a-4936-be71-3aa7d0b4c245 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:04.824028 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d3c8cb2a-310a-4936-be71-3aa7d0b4c245 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:04.824445 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d3c8cb2a-310a-4936-be71-3aa7d0b4c245 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:04.958108 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-d3c8cb2a-310a-4936-be71-3aa7d0b4c245 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:04.966042 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-d3c8cb2a-310a-4936-be71-3aa7d0b4c245 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:04.967477 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-d3c8cb2a-310a-4936-be71-3aa7d0b4c245 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:04.968646 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d3c8cb2a-310a-4936-be71-3aa7d0b4c245 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1731 microversion: 2.20 time: 0.157916 Sep 06 01:18:04.969193 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 461/953] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:18:04 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:18:05.994007 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-445b7b0f-b9e9-4d0e-8ddb-b703fbd1f490 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:05.994618 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-445b7b0f-b9e9-4d0e-8ddb-b703fbd1f490 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:06.001166 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-445b7b0f-b9e9-4d0e-8ddb-b703fbd1f490 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:06.001648 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-445b7b0f-b9e9-4d0e-8ddb-b703fbd1f490 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:06.002081 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-445b7b0f-b9e9-4d0e-8ddb-b703fbd1f490 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:06.003041 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-445b7b0f-b9e9-4d0e-8ddb-b703fbd1f490 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:06.003499 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-445b7b0f-b9e9-4d0e-8ddb-b703fbd1f490 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:06.004039 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-445b7b0f-b9e9-4d0e-8ddb-b703fbd1f490 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:06.133536 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-445b7b0f-b9e9-4d0e-8ddb-b703fbd1f490 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:06.141460 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-445b7b0f-b9e9-4d0e-8ddb-b703fbd1f490 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:06.142884 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-445b7b0f-b9e9-4d0e-8ddb-b703fbd1f490 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:06.144066 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-445b7b0f-b9e9-4d0e-8ddb-b703fbd1f490 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1731 microversion: 2.20 time: 0.153975 Sep 06 01:18:06.144616 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 493/954] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:18:05 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:18:07.169627 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-29e3b0fa-3577-43ff-b05b-0ed5ca3d66d2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:07.170259 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-29e3b0fa-3577-43ff-b05b-0ed5ca3d66d2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:07.177449 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-29e3b0fa-3577-43ff-b05b-0ed5ca3d66d2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:07.177929 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-29e3b0fa-3577-43ff-b05b-0ed5ca3d66d2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:07.178356 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-29e3b0fa-3577-43ff-b05b-0ed5ca3d66d2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:07.179035 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-29e3b0fa-3577-43ff-b05b-0ed5ca3d66d2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:07.179485 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-29e3b0fa-3577-43ff-b05b-0ed5ca3d66d2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:07.179941 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-29e3b0fa-3577-43ff-b05b-0ed5ca3d66d2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:07.312283 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-29e3b0fa-3577-43ff-b05b-0ed5ca3d66d2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:07.320451 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-29e3b0fa-3577-43ff-b05b-0ed5ca3d66d2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:07.321899 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-29e3b0fa-3577-43ff-b05b-0ed5ca3d66d2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:07.323068 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-29e3b0fa-3577-43ff-b05b-0ed5ca3d66d2 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1731 microversion: 2.20 time: 0.157616 Sep 06 01:18:07.323619 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 462/955] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:18:07 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:18:08.348286 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-65fe3f8d-17da-414f-bb4a-7f4bf48dc7b8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:08.348937 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-65fe3f8d-17da-414f-bb4a-7f4bf48dc7b8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:08.355214 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-65fe3f8d-17da-414f-bb4a-7f4bf48dc7b8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:08.355689 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-65fe3f8d-17da-414f-bb4a-7f4bf48dc7b8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:08.356155 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-65fe3f8d-17da-414f-bb4a-7f4bf48dc7b8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:08.356837 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-65fe3f8d-17da-414f-bb4a-7f4bf48dc7b8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:08.357300 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-65fe3f8d-17da-414f-bb4a-7f4bf48dc7b8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:08.357916 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-65fe3f8d-17da-414f-bb4a-7f4bf48dc7b8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:08.504776 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-65fe3f8d-17da-414f-bb4a-7f4bf48dc7b8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:08.513561 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-65fe3f8d-17da-414f-bb4a-7f4bf48dc7b8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:08.515012 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-65fe3f8d-17da-414f-bb4a-7f4bf48dc7b8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:08.516713 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-65fe3f8d-17da-414f-bb4a-7f4bf48dc7b8 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1731 microversion: 2.20 time: 0.172739 Sep 06 01:18:08.517444 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 494/956] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:18:08 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:18:09.544632 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1255b11b-7499-4ceb-a7a9-3c330f908900 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:09.545293 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1255b11b-7499-4ceb-a7a9-3c330f908900 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:09.551717 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1255b11b-7499-4ceb-a7a9-3c330f908900 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:09.552225 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1255b11b-7499-4ceb-a7a9-3c330f908900 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:09.552679 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1255b11b-7499-4ceb-a7a9-3c330f908900 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:09.553555 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1255b11b-7499-4ceb-a7a9-3c330f908900 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:09.554003 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1255b11b-7499-4ceb-a7a9-3c330f908900 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:09.554418 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1255b11b-7499-4ceb-a7a9-3c330f908900 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:09.713760 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-1255b11b-7499-4ceb-a7a9-3c330f908900 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:09.719577 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-54e6d10e-b278-4c2d-9e77-1f9cfa98a06c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:09.720144 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-54e6d10e-b278-4c2d-9e77-1f9cfa98a06c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: 35b05aea-d090-4dfc-ac48-250f71e9da06] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:09.726950 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-54e6d10e-b278-4c2d-9e77-1f9cfa98a06c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:09.727531 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-54e6d10e-b278-4c2d-9e77-1f9cfa98a06c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:09.728079 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-54e6d10e-b278-4c2d-9e77-1f9cfa98a06c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:09.728970 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-54e6d10e-b278-4c2d-9e77-1f9cfa98a06c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:09.729486 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-54e6d10e-b278-4c2d-9e77-1f9cfa98a06c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:09.729974 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-54e6d10e-b278-4c2d-9e77-1f9cfa98a06c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:09.733361 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-1255b11b-7499-4ceb-a7a9-3c330f908900 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:09.734819 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-1255b11b-7499-4ceb-a7a9-3c330f908900 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:09.736051 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1255b11b-7499-4ceb-a7a9-3c330f908900 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1731 microversion: 2.20 time: 0.196181 Sep 06 01:18:09.736924 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 463/957] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:18:09 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1731 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:18:09.811775 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.objects.instance [None req-54e6d10e-b278-4c2d-9e77-1f9cfa98a06c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lazy-loading 'services' on Instance uuid 35b05aea-d090-4dfc-ac48-250f71e9da06 {{(pid=120580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 01:18:09.888771 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-54e6d10e-b278-4c2d-9e77-1f9cfa98a06c tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "DELETE /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06/os-volume_attachments/0fe20465-8966-4dac-ba9a-8b17ffae90a7" status: 202 len: 0 microversion: 2.1 time: 0.173420 Sep 06 01:18:09.889293 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 495/958] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Sep 6 01:18:09 2022] DELETE /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06/os-volume_attachments/0fe20465-8966-4dac-ba9a-8b17ffae90a7 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 01:18:09.897647 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-43beffa8-d7c1-47c5-b37e-e68733c3d962 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:09.899977 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-43beffa8-d7c1-47c5-b37e-e68733c3d962 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: 35b05aea-d090-4dfc-ac48-250f71e9da06] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:09.906461 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-43beffa8-d7c1-47c5-b37e-e68733c3d962 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:09.907259 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-43beffa8-d7c1-47c5-b37e-e68733c3d962 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:09.907915 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-43beffa8-d7c1-47c5-b37e-e68733c3d962 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:09.908955 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-43beffa8-d7c1-47c5-b37e-e68733c3d962 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:09.909634 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-43beffa8-d7c1-47c5-b37e-e68733c3d962 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:09.910104 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-43beffa8-d7c1-47c5-b37e-e68733c3d962 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:09.948236 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-43beffa8-d7c1-47c5-b37e-e68733c3d962 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054437 Sep 06 01:18:09.948788 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 464/959] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 6 01:18:09 2022] GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:18:10.763290 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-1162609d-e414-4c69-aa28-7bb3732f2656 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:10.764060 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-1162609d-e414-4c69-aa28-7bb3732f2656 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:10.770741 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1162609d-e414-4c69-aa28-7bb3732f2656 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:10.771226 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1162609d-e414-4c69-aa28-7bb3732f2656 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:10.771682 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1162609d-e414-4c69-aa28-7bb3732f2656 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:10.772398 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1162609d-e414-4c69-aa28-7bb3732f2656 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:10.772849 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1162609d-e414-4c69-aa28-7bb3732f2656 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:10.773280 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1162609d-e414-4c69-aa28-7bb3732f2656 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:10.921697 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-1162609d-e414-4c69-aa28-7bb3732f2656 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:10.930129 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-1162609d-e414-4c69-aa28-7bb3732f2656 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:10.931685 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-1162609d-e414-4c69-aa28-7bb3732f2656 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:10.933281 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-1162609d-e414-4c69-aa28-7bb3732f2656 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1731 microversion: 2.20 time: 0.174625 Sep 06 01:18:10.933937 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 496/960] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:18:10 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:18:10.961172 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d66bade2-f4de-4bb8-8470-f49105bc5d19 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:10.963364 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d66bade2-f4de-4bb8-8470-f49105bc5d19 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: 35b05aea-d090-4dfc-ac48-250f71e9da06] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:10.969726 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d66bade2-f4de-4bb8-8470-f49105bc5d19 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:10.970208 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d66bade2-f4de-4bb8-8470-f49105bc5d19 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:10.970646 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d66bade2-f4de-4bb8-8470-f49105bc5d19 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:10.971338 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d66bade2-f4de-4bb8-8470-f49105bc5d19 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:10.971839 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d66bade2-f4de-4bb8-8470-f49105bc5d19 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:10.972239 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d66bade2-f4de-4bb8-8470-f49105bc5d19 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:11.002305 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d66bade2-f4de-4bb8-8470-f49105bc5d19 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045545 Sep 06 01:18:11.002886 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 465/961] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 6 01:18:10 2022] GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 01:18:11.071876 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-ccbbfd3f-299a-4fff-92f9-54d9246e378b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:11.072405 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-ccbbfd3f-299a-4fff-92f9-54d9246e378b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: 35b05aea-d090-4dfc-ac48-250f71e9da06] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:11.079277 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ccbbfd3f-299a-4fff-92f9-54d9246e378b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:11.079826 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ccbbfd3f-299a-4fff-92f9-54d9246e378b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:11.080274 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ccbbfd3f-299a-4fff-92f9-54d9246e378b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:11.080981 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ccbbfd3f-299a-4fff-92f9-54d9246e378b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:11.081440 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ccbbfd3f-299a-4fff-92f9-54d9246e378b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:11.081883 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ccbbfd3f-299a-4fff-92f9-54d9246e378b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:11.108850 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-ccbbfd3f-299a-4fff-92f9-54d9246e378b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: 35b05aea-d090-4dfc-ac48-250f71e9da06] Going to try to terminate instance {{(pid=120580) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 01:18:11.182438 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-ccbbfd3f-299a-4fff-92f9-54d9246e378b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "DELETE /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06" status: 204 len: 0 microversion: 2.1 time: 0.114596 Sep 06 01:18:11.183014 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 497/962] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 6 01:18:11 2022] DELETE /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 01:18:11.192970 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e9f5a8fe-9198-4139-9508-893a1b6cb2e2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:11.193576 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e9f5a8fe-9198-4139-9508-893a1b6cb2e2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: 35b05aea-d090-4dfc-ac48-250f71e9da06] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:11.199377 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9f5a8fe-9198-4139-9508-893a1b6cb2e2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:11.199882 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9f5a8fe-9198-4139-9508-893a1b6cb2e2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:11.200317 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9f5a8fe-9198-4139-9508-893a1b6cb2e2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:11.201001 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9f5a8fe-9198-4139-9508-893a1b6cb2e2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:11.201449 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9f5a8fe-9198-4139-9508-893a1b6cb2e2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:11.201867 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9f5a8fe-9198-4139-9508-893a1b6cb2e2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:11.328186 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-e9f5a8fe-9198-4139-9508-893a1b6cb2e2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:11.336110 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e9f5a8fe-9198-4139-9508-893a1b6cb2e2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06" status: 200 len: 1681 microversion: 2.1 time: 0.147907 Sep 06 01:18:11.336682 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 466/963] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:18:11 2022] GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:18:11.959021 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-3a37143f-99dd-426d-a9c0-86bee5fa9401 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:11.959806 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-3a37143f-99dd-426d-a9c0-86bee5fa9401 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:11.966291 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3a37143f-99dd-426d-a9c0-86bee5fa9401 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:11.966777 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3a37143f-99dd-426d-a9c0-86bee5fa9401 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:11.967214 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3a37143f-99dd-426d-a9c0-86bee5fa9401 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:11.967935 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3a37143f-99dd-426d-a9c0-86bee5fa9401 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:11.968389 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3a37143f-99dd-426d-a9c0-86bee5fa9401 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:11.968812 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3a37143f-99dd-426d-a9c0-86bee5fa9401 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:12.105032 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-3a37143f-99dd-426d-a9c0-86bee5fa9401 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:12.114677 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-3a37143f-99dd-426d-a9c0-86bee5fa9401 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:12.116209 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-3a37143f-99dd-426d-a9c0-86bee5fa9401 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:12.117509 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-3a37143f-99dd-426d-a9c0-86bee5fa9401 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1731 microversion: 2.20 time: 0.162820 Sep 06 01:18:12.118038 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 498/964] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:18:11 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:18:12.238752 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-4e31597b-4c1f-48b0-8308-e4f02ec3501d req-33863ae3-8bb3-4ad1-bed6-46aab1a72d42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "366390df-669b-48b1-b741-56d5fdd64441", "name": "network-vif-plugged", "status": "completed", "tag": "703a4acd-427c-4fd4-bf73-f445a5bcac26"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:18:12.249750 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-4e31597b-4c1f-48b0-8308-e4f02ec3501d req-33863ae3-8bb3-4ad1-bed6-46aab1a72d42 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:12.250238 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-4e31597b-4c1f-48b0-8308-e4f02ec3501d req-33863ae3-8bb3-4ad1-bed6-46aab1a72d42 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:12.252035 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-4e31597b-4c1f-48b0-8308-e4f02ec3501d req-33863ae3-8bb3-4ad1-bed6-46aab1a72d42 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:12.264790 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-4e31597b-4c1f-48b0-8308-e4f02ec3501d req-33863ae3-8bb3-4ad1-bed6-46aab1a72d42 service nova] Creating event network-vif-plugged:703a4acd-427c-4fd4-bf73-f445a5bcac26 for instance 366390df-669b-48b1-b741-56d5fdd64441 on hv-cinder-84773 Sep 06 01:18:12.271590 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-4e31597b-4c1f-48b0-8308-e4f02ec3501d req-33863ae3-8bb3-4ad1-bed6-46aab1a72d42 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037056 Sep 06 01:18:12.272214 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 467/965] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:18:12.358973 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-ed3b6ac9-3388-47c4-ae39-c4e6fc2715e3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:12.359591 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-ed3b6ac9-3388-47c4-ae39-c4e6fc2715e3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: 35b05aea-d090-4dfc-ac48-250f71e9da06] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:12.365580 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ed3b6ac9-3388-47c4-ae39-c4e6fc2715e3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:12.366071 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ed3b6ac9-3388-47c4-ae39-c4e6fc2715e3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:12.366503 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ed3b6ac9-3388-47c4-ae39-c4e6fc2715e3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:12.367217 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ed3b6ac9-3388-47c4-ae39-c4e6fc2715e3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:12.367650 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ed3b6ac9-3388-47c4-ae39-c4e6fc2715e3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:12.368187 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ed3b6ac9-3388-47c4-ae39-c4e6fc2715e3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:12.525219 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-ed3b6ac9-3388-47c4-ae39-c4e6fc2715e3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:12.533251 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-ed3b6ac9-3388-47c4-ae39-c4e6fc2715e3 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06" status: 200 len: 1681 microversion: 2.1 time: 0.178231 Sep 06 01:18:12.533844 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 499/966] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:18:12 2022] GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06 => generated 1681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:18:13.143281 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dc7669a6-fd51-4bb4-bcfd-aff495655082 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:13.144060 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-dc7669a6-fd51-4bb4-bcfd-aff495655082 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:13.150584 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc7669a6-fd51-4bb4-bcfd-aff495655082 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:13.151073 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc7669a6-fd51-4bb4-bcfd-aff495655082 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:13.151518 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc7669a6-fd51-4bb4-bcfd-aff495655082 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:13.152267 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc7669a6-fd51-4bb4-bcfd-aff495655082 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:13.152723 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc7669a6-fd51-4bb4-bcfd-aff495655082 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:13.153147 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc7669a6-fd51-4bb4-bcfd-aff495655082 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:13.289009 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-dc7669a6-fd51-4bb4-bcfd-aff495655082 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:13.297756 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-dc7669a6-fd51-4bb4-bcfd-aff495655082 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:13.299222 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-dc7669a6-fd51-4bb4-bcfd-aff495655082 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:13.300502 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dc7669a6-fd51-4bb4-bcfd-aff495655082 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1731 microversion: 2.20 time: 0.161670 Sep 06 01:18:13.301175 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 468/967] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:18:13 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:18:13.560033 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-a05a0119-d510-4b1f-844b-2840c06b04eb tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:13.560653 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-a05a0119-d510-4b1f-844b-2840c06b04eb tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: 35b05aea-d090-4dfc-ac48-250f71e9da06] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:13.567967 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a05a0119-d510-4b1f-844b-2840c06b04eb tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:13.568450 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a05a0119-d510-4b1f-844b-2840c06b04eb tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:13.568883 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a05a0119-d510-4b1f-844b-2840c06b04eb tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:13.569754 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a05a0119-d510-4b1f-844b-2840c06b04eb tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:13.570358 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a05a0119-d510-4b1f-844b-2840c06b04eb tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:13.570945 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a05a0119-d510-4b1f-844b-2840c06b04eb tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:13.736630 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-a05a0119-d510-4b1f-844b-2840c06b04eb tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:13.740112 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell1:UPDATE=5,nova_cell1:INSERT=3,nova_cell1:SELECT=92 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:18:13.761890 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-a05a0119-d510-4b1f-844b-2840c06b04eb tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06" status: 200 len: 1681 microversion: 2.1 time: 0.206693 Sep 06 01:18:13.762652 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 500/968] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:18:13 2022] GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06 => generated 1681 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:18:14.114683 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-3dcc11d2-c817-435c-bc14-13b9e3afeb51 req-ee2e7c6e-bb58-4141-b91d-f5da7f56149d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35b05aea-d090-4dfc-ac48-250f71e9da06", "name": "network-vif-deleted", "tag": "5a34555a-ae18-454c-8599-cc82f05f0e3c"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:18:14.123861 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3dcc11d2-c817-435c-bc14-13b9e3afeb51 req-ee2e7c6e-bb58-4141-b91d-f5da7f56149d service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:14.124361 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3dcc11d2-c817-435c-bc14-13b9e3afeb51 req-ee2e7c6e-bb58-4141-b91d-f5da7f56149d service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:14.124789 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3dcc11d2-c817-435c-bc14-13b9e3afeb51 req-ee2e7c6e-bb58-4141-b91d-f5da7f56149d service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:14.135490 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-3dcc11d2-c817-435c-bc14-13b9e3afeb51 req-ee2e7c6e-bb58-4141-b91d-f5da7f56149d service nova] Creating event network-vif-deleted:5a34555a-ae18-454c-8599-cc82f05f0e3c for instance 35b05aea-d090-4dfc-ac48-250f71e9da06 on hv-cinder-84773 Sep 06 01:18:14.140360 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-3dcc11d2-c817-435c-bc14-13b9e3afeb51 req-ee2e7c6e-bb58-4141-b91d-f5da7f56149d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030005 Sep 06 01:18:14.140936 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 469/969] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:18:14.327400 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-2b81a8c2-da4f-4d52-bf18-3f4d0e7ab09f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:14.328071 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-2b81a8c2-da4f-4d52-bf18-3f4d0e7ab09f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:14.336160 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2b81a8c2-da4f-4d52-bf18-3f4d0e7ab09f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:14.336651 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2b81a8c2-da4f-4d52-bf18-3f4d0e7ab09f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:14.337085 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2b81a8c2-da4f-4d52-bf18-3f4d0e7ab09f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:14.337794 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2b81a8c2-da4f-4d52-bf18-3f4d0e7ab09f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:14.338241 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2b81a8c2-da4f-4d52-bf18-3f4d0e7ab09f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:14.338660 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2b81a8c2-da4f-4d52-bf18-3f4d0e7ab09f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:14.473560 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-2b81a8c2-da4f-4d52-bf18-3f4d0e7ab09f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:14.481555 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-2b81a8c2-da4f-4d52-bf18-3f4d0e7ab09f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:14.483003 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-2b81a8c2-da4f-4d52-bf18-3f4d0e7ab09f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:14.484262 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-2b81a8c2-da4f-4d52-bf18-3f4d0e7ab09f tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1731 microversion: 2.20 time: 0.161667 Sep 06 01:18:14.484828 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 501/970] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:18:14 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:18:14.787300 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-108613e0-6879-4762-869d-d63b31b11350 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:14.788022 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-108613e0-6879-4762-869d-d63b31b11350 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: 35b05aea-d090-4dfc-ac48-250f71e9da06] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:14.794326 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-108613e0-6879-4762-869d-d63b31b11350 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:14.794807 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-108613e0-6879-4762-869d-d63b31b11350 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:14.795240 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-108613e0-6879-4762-869d-d63b31b11350 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:14.795961 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-108613e0-6879-4762-869d-d63b31b11350 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:14.796411 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-108613e0-6879-4762-869d-d63b31b11350 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:14.796830 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-108613e0-6879-4762-869d-d63b31b11350 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:14.863526 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-108613e0-6879-4762-869d-d63b31b11350 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:14.871990 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-108613e0-6879-4762-869d-d63b31b11350 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06" status: 200 len: 1613 microversion: 2.1 time: 0.089182 Sep 06 01:18:14.872571 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 470/971] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:18:14 2022] GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06 => generated 1613 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:18:15.509696 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-efdf3137-5660-4f2c-8e06-6a08043135bc tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:15.510231 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-efdf3137-5660-4f2c-8e06-6a08043135bc tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:15.516622 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-efdf3137-5660-4f2c-8e06-6a08043135bc tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:15.517105 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-efdf3137-5660-4f2c-8e06-6a08043135bc tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:15.517542 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-efdf3137-5660-4f2c-8e06-6a08043135bc tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:15.518230 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-efdf3137-5660-4f2c-8e06-6a08043135bc tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:15.518683 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-efdf3137-5660-4f2c-8e06-6a08043135bc tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:15.519136 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-efdf3137-5660-4f2c-8e06-6a08043135bc tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:15.650410 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-efdf3137-5660-4f2c-8e06-6a08043135bc tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:15.658445 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-efdf3137-5660-4f2c-8e06-6a08043135bc tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:15.660486 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-efdf3137-5660-4f2c-8e06-6a08043135bc tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:15.661717 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-efdf3137-5660-4f2c-8e06-6a08043135bc tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1731 microversion: 2.20 time: 0.156035 Sep 06 01:18:15.662277 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 502/972] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:18:15 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:18:15.895933 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6f0a2e1f-3ce7-413b-b337-cefa6c625f30 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:15.896550 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6f0a2e1f-3ce7-413b-b337-cefa6c625f30 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: 35b05aea-d090-4dfc-ac48-250f71e9da06] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:15.902810 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f0a2e1f-3ce7-413b-b337-cefa6c625f30 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:15.903304 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f0a2e1f-3ce7-413b-b337-cefa6c625f30 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:15.903740 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f0a2e1f-3ce7-413b-b337-cefa6c625f30 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:15.904456 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f0a2e1f-3ce7-413b-b337-cefa6c625f30 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:15.904912 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f0a2e1f-3ce7-413b-b337-cefa6c625f30 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:15.905366 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f0a2e1f-3ce7-413b-b337-cefa6c625f30 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:15.966466 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-6f0a2e1f-3ce7-413b-b337-cefa6c625f30 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:15.974621 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6f0a2e1f-3ce7-413b-b337-cefa6c625f30 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06" status: 200 len: 1613 microversion: 2.1 time: 0.083073 Sep 06 01:18:15.975176 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 471/973] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:18:15 2022] GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06 => generated 1613 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:18:16.688088 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-6b1e0e7e-c87c-4da5-8b1c-fcff8b293f1c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:16.688903 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-6b1e0e7e-c87c-4da5-8b1c-fcff8b293f1c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:16.696786 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6b1e0e7e-c87c-4da5-8b1c-fcff8b293f1c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:16.697279 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6b1e0e7e-c87c-4da5-8b1c-fcff8b293f1c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:16.697711 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6b1e0e7e-c87c-4da5-8b1c-fcff8b293f1c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:16.698419 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6b1e0e7e-c87c-4da5-8b1c-fcff8b293f1c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:16.698874 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6b1e0e7e-c87c-4da5-8b1c-fcff8b293f1c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:16.699292 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6b1e0e7e-c87c-4da5-8b1c-fcff8b293f1c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:16.837591 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-6b1e0e7e-c87c-4da5-8b1c-fcff8b293f1c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:16.847098 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-6b1e0e7e-c87c-4da5-8b1c-fcff8b293f1c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:16.848916 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-6b1e0e7e-c87c-4da5-8b1c-fcff8b293f1c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:16.850085 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-6b1e0e7e-c87c-4da5-8b1c-fcff8b293f1c tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1731 microversion: 2.20 time: 0.166443 Sep 06 01:18:16.850797 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 503/974] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:18:16 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:18:16.997947 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c270744d-fda8-490b-b702-1ff0d5b7ab9b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:16.998675 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c270744d-fda8-490b-b702-1ff0d5b7ab9b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: 35b05aea-d090-4dfc-ac48-250f71e9da06] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:17.006893 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c270744d-fda8-490b-b702-1ff0d5b7ab9b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:17.007436 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c270744d-fda8-490b-b702-1ff0d5b7ab9b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:17.008349 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c270744d-fda8-490b-b702-1ff0d5b7ab9b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:17.009525 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c270744d-fda8-490b-b702-1ff0d5b7ab9b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:17.009851 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c270744d-fda8-490b-b702-1ff0d5b7ab9b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:17.010304 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c270744d-fda8-490b-b702-1ff0d5b7ab9b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:17.032648 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:18:17.049919 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c270744d-fda8-490b-b702-1ff0d5b7ab9b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:17.049919 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c270744d-fda8-490b-b702-1ff0d5b7ab9b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:17.049919 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c270744d-fda8-490b-b702-1ff0d5b7ab9b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:17.049919 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-c270744d-fda8-490b-b702-1ff0d5b7ab9b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lazy-loading 'fault' on Instance uuid 35b05aea-d090-4dfc-ac48-250f71e9da06 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 01:18:17.100275 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-c270744d-fda8-490b-b702-1ff0d5b7ab9b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f44df824414e5ebc8cfd2126e9d66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa73b0bfee14a9ea25f03e523078995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:17.112764 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c270744d-fda8-490b-b702-1ff0d5b7ab9b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06" status: 200 len: 1331 microversion: 2.1 time: 0.119141 Sep 06 01:18:17.113609 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 472/975] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:18:16 2022] GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06 => generated 1331 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:18:17.876514 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-4ff7f8ff-09b0-4ae0-9098-d7b424c18e39 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:17.877049 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-4ff7f8ff-09b0-4ae0-9098-d7b424c18e39 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:17.883481 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4ff7f8ff-09b0-4ae0-9098-d7b424c18e39 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:17.883995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4ff7f8ff-09b0-4ae0-9098-d7b424c18e39 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:17.884428 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4ff7f8ff-09b0-4ae0-9098-d7b424c18e39 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:17.885116 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4ff7f8ff-09b0-4ae0-9098-d7b424c18e39 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:17.885570 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4ff7f8ff-09b0-4ae0-9098-d7b424c18e39 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:17.885998 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4ff7f8ff-09b0-4ae0-9098-d7b424c18e39 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:18.011611 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-4ff7f8ff-09b0-4ae0-9098-d7b424c18e39 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:18.020348 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-4ff7f8ff-09b0-4ae0-9098-d7b424c18e39 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:18.021782 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-4ff7f8ff-09b0-4ae0-9098-d7b424c18e39 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:18.022955 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-4ff7f8ff-09b0-4ae0-9098-d7b424c18e39 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1718 microversion: 2.20 time: 0.150476 Sep 06 01:18:18.023528 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 504/976] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:18:17 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:18:18.136723 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4f62ed13-bc0f-4baa-98ae-7873a8d6c963 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:18.137251 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4f62ed13-bc0f-4baa-98ae-7873a8d6c963 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: 35b05aea-d090-4dfc-ac48-250f71e9da06] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:18.143866 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f62ed13-bc0f-4baa-98ae-7873a8d6c963 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:18.144873 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f62ed13-bc0f-4baa-98ae-7873a8d6c963 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:18.145285 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f62ed13-bc0f-4baa-98ae-7873a8d6c963 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:18.145993 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f62ed13-bc0f-4baa-98ae-7873a8d6c963 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:18.146443 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f62ed13-bc0f-4baa-98ae-7873a8d6c963 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:18.146861 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f62ed13-bc0f-4baa-98ae-7873a8d6c963 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:18.160806 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-4f62ed13-bc0f-4baa-98ae-7873a8d6c963 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] HTTP exception thrown: Instance 35b05aea-d090-4dfc-ac48-250f71e9da06 could not be found. Sep 06 01:18:18.162416 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4f62ed13-bc0f-4baa-98ae-7873a8d6c963 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Request method failure captured: Sep 06 01:18:18.162416 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06 HTTP/1.1 Sep 06 01:18:18.162416 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept: application/json Sep 06 01:18:18.162416 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept-Encoding: identity Sep 06 01:18:18.162416 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Connection: close Sep 06 01:18:18.162416 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Length: 0 Sep 06 01:18:18.162416 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Type: application/json Sep 06 01:18:18.162416 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Host: 10.222.0.23 Sep 06 01:18:18.162416 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Openstack-System-Scope: None Sep 06 01:18:18.162416 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Sep 06 01:18:18.162416 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjFp5HgEJZI7pOCAbhWXwWFE8yQ5t7K_Ws-jshDHbF7sXnYLPl16IIONgrpvYxWiZSDSAeitprugb5h17_eYSiBNUfLgmC9hbcnAOoP7NTvslLSb0CTURVLZpiFrwKL1VvcCbnqL_bQbP7LRSB17fvFEoXQ1dcjQQQPX7LNrOn0pG4F5A Sep 06 01:18:18.162416 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Id: None Sep 06 01:18:18.162416 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Name: None Sep 06 01:18:18.162416 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Identity-Status: Confirmed Sep 06 01:18:18.162416 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Is-Admin-Project: True Sep 06 01:18:18.162416 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Id: default Sep 06 01:18:18.162416 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Name: Default Sep 06 01:18:18.162416 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Id: 1fa73b0bfee14a9ea25f03e523078995 Sep 06 01:18:18.162416 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Name: tempest-AttachVolumeNegativeTest-1412452604 Sep 06 01:18:18.162416 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Role: reader,member Sep 06 01:18:18.162416 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Roles: reader,member Sep 06 01:18:18.164081 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1fa73b0bfee14a9ea25f03e523078995"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1fa73b0bfee14a9ea25f03e523078995"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1fa73b0bfee14a9ea25f03e523078995"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1fa73b0bfee14a9ea25f03e523078995"}]}] Sep 06 01:18:18.164081 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant: tempest-AttachVolumeNegativeTest-1412452604 Sep 06 01:18:18.164081 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Id: 1fa73b0bfee14a9ea25f03e523078995 Sep 06 01:18:18.164081 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1412452604 Sep 06 01:18:18.164081 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User: tempest-AttachVolumeNegativeTest-1412452604-project Sep 06 01:18:18.164081 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Id: default Sep 06 01:18:18.164081 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Name: Default Sep 06 01:18:18.164081 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Id: f8f44df824414e5ebc8cfd2126e9d66f Sep 06 01:18:18.164081 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Name: tempest-AttachVolumeNegativeTest-1412452604-project Sep 06 01:18:18.164081 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: method: > Sep 06 01:18:18.164081 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: exception: Instance 35b05aea-d090-4dfc-ac48-250f71e9da06 could not be found. Sep 06 01:18:18.164081 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: action_args: {'id': '35b05aea-d090-4dfc-ac48-250f71e9da06'} Sep 06 01:18:18.164998 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:18:18.164998 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:18.164998 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 01:18:18.164998 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 01:18:18.164998 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 01:18:18.164998 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 01:18:18.164998 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 01:18:18.164998 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 01:18:18.164998 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 01:18:18.164998 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 01:18:18.164998 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35b05aea-d090-4dfc-ac48-250f71e9da06 could not be found. Sep 06 01:18:18.164998 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:18.164998 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:18.164998 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:18.164998 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:18.164998 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:18.164998 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:18.164998 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:18:18.164998 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:18:18.164998 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:18:18.166780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:18:18.166780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 01:18:18.166780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 01:18:18.166780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 01:18:18.166780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 01:18:18.166780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 01:18:18.166780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:18:18.166780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35b05aea-d090-4dfc-ac48-250f71e9da06 could not be found. Sep 06 01:18:18.166780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:18.166780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:18.166780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:18.166780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:18.166780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:18.166780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:18.166780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:18:18.166780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:18:18.166780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35b05aea-d090-4dfc-ac48-250f71e9da06 could not be found. Sep 06 01:18:18.166780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:18.168152 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4f62ed13-bc0f-4baa-98ae-7873a8d6c963 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Returning 404 to user: Instance 35b05aea-d090-4dfc-ac48-250f71e9da06 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:18:18.168152 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4f62ed13-bc0f-4baa-98ae-7873a8d6c963 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06" status: 404 len: 111 microversion: 2.1 time: 0.031016 Sep 06 01:18:18.168152 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 473/977] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:18:18 2022] GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 01:18:18.172745 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-cbec389f-1a6e-4167-bd39-a39666687167 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '.version_select at 0x7fb06e20d0d0>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:18.179564 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:18:18.193037 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-cbec389f-1a6e-4167-bd39-a39666687167 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-468002266" status: 202 len: 0 microversion: 2.1 time: 0.024067 Sep 06 01:18:18.193627 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 505/978] 10.222.0.23 () {58 vars in 1218 bytes} [Tue Sep 6 01:18:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-468002266 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 01:18:19.945003 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e06eadf0-79ba-49ef-9b58-46bb997a3b3b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:19.945460 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e06eadf0-79ba-49ef-9b58-46bb997a3b3b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: 35b05aea-d090-4dfc-ac48-250f71e9da06] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:19.951775 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e06eadf0-79ba-49ef-9b58-46bb997a3b3b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:19.952283 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e06eadf0-79ba-49ef-9b58-46bb997a3b3b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:19.952725 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e06eadf0-79ba-49ef-9b58-46bb997a3b3b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:19.953421 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e06eadf0-79ba-49ef-9b58-46bb997a3b3b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:19.953881 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e06eadf0-79ba-49ef-9b58-46bb997a3b3b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:19.954311 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e06eadf0-79ba-49ef-9b58-46bb997a3b3b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:19.967530 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-e06eadf0-79ba-49ef-9b58-46bb997a3b3b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] HTTP exception thrown: Instance 35b05aea-d090-4dfc-ac48-250f71e9da06 could not be found. Sep 06 01:18:19.969434 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e06eadf0-79ba-49ef-9b58-46bb997a3b3b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Request method failure captured: Sep 06 01:18:19.969434 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06 HTTP/1.1 Sep 06 01:18:19.969434 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept: application/json Sep 06 01:18:19.969434 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept-Encoding: identity Sep 06 01:18:19.969434 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Connection: close Sep 06 01:18:19.969434 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Length: 0 Sep 06 01:18:19.969434 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Type: application/json Sep 06 01:18:19.969434 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Host: 10.222.0.23 Sep 06 01:18:19.969434 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Openstack-System-Scope: None Sep 06 01:18:19.969434 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Sep 06 01:18:19.969434 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjFp5HgEJZI7pOCAbhWXwWFE8yQ5t7K_Ws-jshDHbF7sXnYLPl16IIONgrpvYxWiZSDSAeitprugb5h17_eYSiBNUfLgmC9hbcnAOoP7NTvslLSb0CTURVLZpiFrwKL1VvcCbnqL_bQbP7LRSB17fvFEoXQ1dcjQQQPX7LNrOn0pG4F5A Sep 06 01:18:19.969434 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Id: None Sep 06 01:18:19.969434 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Name: None Sep 06 01:18:19.969434 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Identity-Status: Confirmed Sep 06 01:18:19.969434 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Is-Admin-Project: True Sep 06 01:18:19.969434 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Id: default Sep 06 01:18:19.969434 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Name: Default Sep 06 01:18:19.969434 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Id: 1fa73b0bfee14a9ea25f03e523078995 Sep 06 01:18:19.969434 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Name: tempest-AttachVolumeNegativeTest-1412452604 Sep 06 01:18:19.969434 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Role: reader,member Sep 06 01:18:19.969434 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Roles: reader,member Sep 06 01:18:19.970983 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1fa73b0bfee14a9ea25f03e523078995"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1fa73b0bfee14a9ea25f03e523078995"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1fa73b0bfee14a9ea25f03e523078995"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1fa73b0bfee14a9ea25f03e523078995"}]}] Sep 06 01:18:19.970983 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant: tempest-AttachVolumeNegativeTest-1412452604 Sep 06 01:18:19.970983 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Id: 1fa73b0bfee14a9ea25f03e523078995 Sep 06 01:18:19.970983 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1412452604 Sep 06 01:18:19.970983 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User: tempest-AttachVolumeNegativeTest-1412452604-project Sep 06 01:18:19.970983 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Id: default Sep 06 01:18:19.970983 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Name: Default Sep 06 01:18:19.970983 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Id: f8f44df824414e5ebc8cfd2126e9d66f Sep 06 01:18:19.970983 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Name: tempest-AttachVolumeNegativeTest-1412452604-project Sep 06 01:18:19.970983 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: method: > Sep 06 01:18:19.970983 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: exception: Instance 35b05aea-d090-4dfc-ac48-250f71e9da06 could not be found. Sep 06 01:18:19.970983 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: action_args: {'id': '35b05aea-d090-4dfc-ac48-250f71e9da06'} Sep 06 01:18:19.975374 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:18:19.975374 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:19.975374 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 01:18:19.975374 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 01:18:19.975374 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 01:18:19.975374 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 01:18:19.975374 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 01:18:19.975374 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 01:18:19.975374 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 01:18:19.975374 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 01:18:19.975374 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35b05aea-d090-4dfc-ac48-250f71e9da06 could not be found. Sep 06 01:18:19.975374 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:19.975374 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:19.975374 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:19.975374 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:19.975374 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:19.975374 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:19.975374 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:18:19.975374 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:18:19.975374 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:18:19.976772 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:18:19.976772 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 01:18:19.976772 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 01:18:19.976772 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 01:18:19.976772 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 01:18:19.976772 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 01:18:19.976772 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 01:18:19.976772 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 01:18:19.976772 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:18:19.976772 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35b05aea-d090-4dfc-ac48-250f71e9da06 could not be found. Sep 06 01:18:19.976772 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:19.976772 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:19.976772 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:19.976772 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:19.976772 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:19.976772 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:19.976772 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:18:19.976772 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:18:19.976772 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35b05aea-d090-4dfc-ac48-250f71e9da06 could not be found. Sep 06 01:18:19.976772 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:19.978151 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e06eadf0-79ba-49ef-9b58-46bb997a3b3b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Returning 404 to user: Instance 35b05aea-d090-4dfc-ac48-250f71e9da06 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:18:19.978151 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e06eadf0-79ba-49ef-9b58-46bb997a3b3b tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "DELETE /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06" status: 404 len: 111 microversion: 2.1 time: 0.029927 Sep 06 01:18:19.978151 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 474/979] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 6 01:18:19 2022] DELETE /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 01:18:19.980796 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-f68ce807-b513-4490-bfb7-8cc1340c1ccd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:19.981432 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-f68ce807-b513-4490-bfb7-8cc1340c1ccd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: 35b05aea-d090-4dfc-ac48-250f71e9da06] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:19.987241 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f68ce807-b513-4490-bfb7-8cc1340c1ccd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:19.987774 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f68ce807-b513-4490-bfb7-8cc1340c1ccd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:19.988928 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f68ce807-b513-4490-bfb7-8cc1340c1ccd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:19.989634 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f68ce807-b513-4490-bfb7-8cc1340c1ccd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:19.990091 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f68ce807-b513-4490-bfb7-8cc1340c1ccd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:19.990516 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f68ce807-b513-4490-bfb7-8cc1340c1ccd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:20.004781 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.wsgi [None req-f68ce807-b513-4490-bfb7-8cc1340c1ccd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] HTTP exception thrown: Instance 35b05aea-d090-4dfc-ac48-250f71e9da06 could not be found. Sep 06 01:18:20.008172 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-f68ce807-b513-4490-bfb7-8cc1340c1ccd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Request method failure captured: Sep 06 01:18:20.008172 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: request: GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06 HTTP/1.1 Sep 06 01:18:20.008172 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept: application/json Sep 06 01:18:20.008172 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept-Encoding: identity Sep 06 01:18:20.008172 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Connection: close Sep 06 01:18:20.008172 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Length: 0 Sep 06 01:18:20.008172 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Type: application/json Sep 06 01:18:20.008172 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Host: 10.222.0.23 Sep 06 01:18:20.008172 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Openstack-System-Scope: None Sep 06 01:18:20.008172 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: User-Agent: python-urllib3/1.26.12 Sep 06 01:18:20.008172 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Auth-Token: gAAAAABjFp5HgEJZI7pOCAbhWXwWFE8yQ5t7K_Ws-jshDHbF7sXnYLPl16IIONgrpvYxWiZSDSAeitprugb5h17_eYSiBNUfLgmC9hbcnAOoP7NTvslLSb0CTURVLZpiFrwKL1VvcCbnqL_bQbP7LRSB17fvFEoXQ1dcjQQQPX7LNrOn0pG4F5A Sep 06 01:18:20.008172 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Id: None Sep 06 01:18:20.008172 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Name: None Sep 06 01:18:20.008172 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Identity-Status: Confirmed Sep 06 01:18:20.008172 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Is-Admin-Project: True Sep 06 01:18:20.008172 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Id: default Sep 06 01:18:20.008172 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Name: Default Sep 06 01:18:20.008172 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Id: 1fa73b0bfee14a9ea25f03e523078995 Sep 06 01:18:20.008172 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Name: tempest-AttachVolumeNegativeTest-1412452604 Sep 06 01:18:20.008172 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Role: reader,member Sep 06 01:18:20.008172 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Roles: reader,member Sep 06 01:18:20.010271 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1fa73b0bfee14a9ea25f03e523078995"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1fa73b0bfee14a9ea25f03e523078995"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1fa73b0bfee14a9ea25f03e523078995"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1fa73b0bfee14a9ea25f03e523078995"}]}] Sep 06 01:18:20.010271 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant: tempest-AttachVolumeNegativeTest-1412452604 Sep 06 01:18:20.010271 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Id: 1fa73b0bfee14a9ea25f03e523078995 Sep 06 01:18:20.010271 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1412452604 Sep 06 01:18:20.010271 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User: tempest-AttachVolumeNegativeTest-1412452604-project Sep 06 01:18:20.010271 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Id: default Sep 06 01:18:20.010271 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Name: Default Sep 06 01:18:20.010271 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Id: f8f44df824414e5ebc8cfd2126e9d66f Sep 06 01:18:20.010271 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Name: tempest-AttachVolumeNegativeTest-1412452604-project Sep 06 01:18:20.010271 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: method: > Sep 06 01:18:20.010271 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: exception: Instance 35b05aea-d090-4dfc-ac48-250f71e9da06 could not be found. Sep 06 01:18:20.010271 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: action_args: {'id': '35b05aea-d090-4dfc-ac48-250f71e9da06'} Sep 06 01:18:20.011165 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:18:20.011165 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:20.011165 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 01:18:20.011165 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 01:18:20.011165 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 01:18:20.011165 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 01:18:20.011165 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 01:18:20.011165 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 01:18:20.011165 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 01:18:20.011165 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 01:18:20.011165 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35b05aea-d090-4dfc-ac48-250f71e9da06 could not be found. Sep 06 01:18:20.011165 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:20.011165 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:20.011165 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:20.011165 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:20.011165 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:20.011165 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:20.011165 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:18:20.011165 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:18:20.011165 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:18:20.012710 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:18:20.012710 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 01:18:20.012710 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 01:18:20.012710 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 01:18:20.012710 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 01:18:20.012710 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 01:18:20.012710 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:18:20.012710 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35b05aea-d090-4dfc-ac48-250f71e9da06 could not be found. Sep 06 01:18:20.012710 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:20.012710 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:20.012710 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:20.012710 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:20.012710 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:20.012710 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:20.012710 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:18:20.012710 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:18:20.012710 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35b05aea-d090-4dfc-ac48-250f71e9da06 could not be found. Sep 06 01:18:20.012710 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:20.013978 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-f68ce807-b513-4490-bfb7-8cc1340c1ccd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Returning 404 to user: Instance 35b05aea-d090-4dfc-ac48-250f71e9da06 could not be found. {{(pid=120580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:18:20.013978 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-f68ce807-b513-4490-bfb7-8cc1340c1ccd tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06" status: 404 len: 111 microversion: 2.1 time: 0.033242 Sep 06 01:18:20.013978 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 506/980] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:18:19 2022] GET /compute/v2.1/servers/35b05aea-d090-4dfc-ac48-250f71e9da06 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 01:18:21.155394 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-4f020be7-10bc-490a-90b4-4af664b9bded tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:21.155919 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-4f020be7-10bc-490a-90b4-4af664b9bded tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: a23ae8e0-f66b-46e1-a6fe-ac890b3efe45] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:21.163490 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4f020be7-10bc-490a-90b4-4af664b9bded tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:21.164005 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4f020be7-10bc-490a-90b4-4af664b9bded tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:21.164449 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4f020be7-10bc-490a-90b4-4af664b9bded tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:21.165149 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4f020be7-10bc-490a-90b4-4af664b9bded tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:21.165600 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4f020be7-10bc-490a-90b4-4af664b9bded tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:21.166270 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4f020be7-10bc-490a-90b4-4af664b9bded tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:21.191742 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.wsgi [None req-4f020be7-10bc-490a-90b4-4af664b9bded tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] HTTP exception thrown: Instance a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 could not be found. Sep 06 01:18:21.193332 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-4f020be7-10bc-490a-90b4-4af664b9bded tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Request method failure captured: Sep 06 01:18:21.193332 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: request: DELETE /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 HTTP/1.1 Sep 06 01:18:21.193332 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept: application/json Sep 06 01:18:21.193332 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept-Encoding: identity Sep 06 01:18:21.193332 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Connection: close Sep 06 01:18:21.193332 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Length: 0 Sep 06 01:18:21.193332 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Type: application/json Sep 06 01:18:21.193332 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Host: 10.222.0.23 Sep 06 01:18:21.193332 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Openstack-System-Scope: None Sep 06 01:18:21.193332 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: User-Agent: python-urllib3/1.26.12 Sep 06 01:18:21.193332 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Auth-Token: gAAAAABjFp5HgEJZI7pOCAbhWXwWFE8yQ5t7K_Ws-jshDHbF7sXnYLPl16IIONgrpvYxWiZSDSAeitprugb5h17_eYSiBNUfLgmC9hbcnAOoP7NTvslLSb0CTURVLZpiFrwKL1VvcCbnqL_bQbP7LRSB17fvFEoXQ1dcjQQQPX7LNrOn0pG4F5A Sep 06 01:18:21.193332 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Id: None Sep 06 01:18:21.193332 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Name: None Sep 06 01:18:21.193332 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Identity-Status: Confirmed Sep 06 01:18:21.193332 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Is-Admin-Project: True Sep 06 01:18:21.193332 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Id: default Sep 06 01:18:21.193332 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Name: Default Sep 06 01:18:21.193332 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Id: 1fa73b0bfee14a9ea25f03e523078995 Sep 06 01:18:21.193332 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Name: tempest-AttachVolumeNegativeTest-1412452604 Sep 06 01:18:21.193332 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Role: reader,member Sep 06 01:18:21.193332 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Roles: reader,member Sep 06 01:18:21.194940 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1fa73b0bfee14a9ea25f03e523078995"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1fa73b0bfee14a9ea25f03e523078995"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1fa73b0bfee14a9ea25f03e523078995"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1fa73b0bfee14a9ea25f03e523078995"}]}] Sep 06 01:18:21.194940 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant: tempest-AttachVolumeNegativeTest-1412452604 Sep 06 01:18:21.194940 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Id: 1fa73b0bfee14a9ea25f03e523078995 Sep 06 01:18:21.194940 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1412452604 Sep 06 01:18:21.194940 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User: tempest-AttachVolumeNegativeTest-1412452604-project Sep 06 01:18:21.194940 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Id: default Sep 06 01:18:21.194940 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Name: Default Sep 06 01:18:21.194940 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Id: f8f44df824414e5ebc8cfd2126e9d66f Sep 06 01:18:21.194940 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Name: tempest-AttachVolumeNegativeTest-1412452604-project Sep 06 01:18:21.194940 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: method: > Sep 06 01:18:21.194940 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: exception: Instance a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 could not be found. Sep 06 01:18:21.194940 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: action_args: {'id': 'a23ae8e0-f66b-46e1-a6fe-ac890b3efe45'} Sep 06 01:18:21.195819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:18:21.195819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:21.195819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 01:18:21.195819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 01:18:21.195819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 01:18:21.195819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 01:18:21.195819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 01:18:21.195819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 01:18:21.195819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 01:18:21.195819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 01:18:21.195819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 could not be found. Sep 06 01:18:21.195819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:21.195819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:21.195819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:21.195819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:21.195819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:21.195819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:21.195819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:18:21.195819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:18:21.195819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:18:21.197197 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:18:21.197197 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 01:18:21.197197 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 01:18:21.197197 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 01:18:21.197197 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 01:18:21.197197 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 01:18:21.197197 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 01:18:21.197197 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 01:18:21.197197 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:18:21.197197 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 could not be found. Sep 06 01:18:21.197197 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:21.197197 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:21.197197 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:21.197197 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:21.197197 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:21.197197 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:21.197197 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:18:21.197197 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:18:21.197197 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 could not be found. Sep 06 01:18:21.197197 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:21.198643 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-4f020be7-10bc-490a-90b4-4af664b9bded tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Returning 404 to user: Instance a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 could not be found. {{(pid=120580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:18:21.198643 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-4f020be7-10bc-490a-90b4-4af664b9bded tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45" status: 404 len: 111 microversion: 2.1 time: 0.043441 Sep 06 01:18:21.198643 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 507/981] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 6 01:18:21 2022] DELETE /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 01:18:21.203249 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-aa04c8b3-7009-4137-8a16-cf46db51d7a6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:21.203977 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-aa04c8b3-7009-4137-8a16-cf46db51d7a6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: a23ae8e0-f66b-46e1-a6fe-ac890b3efe45] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:21.209890 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-aa04c8b3-7009-4137-8a16-cf46db51d7a6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:21.210612 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-aa04c8b3-7009-4137-8a16-cf46db51d7a6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:21.211213 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-aa04c8b3-7009-4137-8a16-cf46db51d7a6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:21.212099 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-aa04c8b3-7009-4137-8a16-cf46db51d7a6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:21.212547 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-aa04c8b3-7009-4137-8a16-cf46db51d7a6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:21.212971 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-aa04c8b3-7009-4137-8a16-cf46db51d7a6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:21.227115 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.wsgi [None req-aa04c8b3-7009-4137-8a16-cf46db51d7a6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] HTTP exception thrown: Instance a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 could not be found. Sep 06 01:18:21.228667 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-aa04c8b3-7009-4137-8a16-cf46db51d7a6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Request method failure captured: Sep 06 01:18:21.228667 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: request: GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 HTTP/1.1 Sep 06 01:18:21.228667 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept: application/json Sep 06 01:18:21.228667 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept-Encoding: identity Sep 06 01:18:21.228667 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Connection: close Sep 06 01:18:21.228667 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Length: 0 Sep 06 01:18:21.228667 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Type: application/json Sep 06 01:18:21.228667 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Host: 10.222.0.23 Sep 06 01:18:21.228667 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Openstack-System-Scope: None Sep 06 01:18:21.228667 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: User-Agent: python-urllib3/1.26.12 Sep 06 01:18:21.228667 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Auth-Token: gAAAAABjFp5HgEJZI7pOCAbhWXwWFE8yQ5t7K_Ws-jshDHbF7sXnYLPl16IIONgrpvYxWiZSDSAeitprugb5h17_eYSiBNUfLgmC9hbcnAOoP7NTvslLSb0CTURVLZpiFrwKL1VvcCbnqL_bQbP7LRSB17fvFEoXQ1dcjQQQPX7LNrOn0pG4F5A Sep 06 01:18:21.228667 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Id: None Sep 06 01:18:21.228667 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Name: None Sep 06 01:18:21.228667 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Identity-Status: Confirmed Sep 06 01:18:21.228667 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Is-Admin-Project: True Sep 06 01:18:21.228667 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Id: default Sep 06 01:18:21.228667 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Name: Default Sep 06 01:18:21.228667 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Id: 1fa73b0bfee14a9ea25f03e523078995 Sep 06 01:18:21.228667 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Name: tempest-AttachVolumeNegativeTest-1412452604 Sep 06 01:18:21.228667 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Role: reader,member Sep 06 01:18:21.228667 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Roles: reader,member Sep 06 01:18:21.229987 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1fa73b0bfee14a9ea25f03e523078995"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1fa73b0bfee14a9ea25f03e523078995"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1fa73b0bfee14a9ea25f03e523078995"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1fa73b0bfee14a9ea25f03e523078995"}]}] Sep 06 01:18:21.229987 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant: tempest-AttachVolumeNegativeTest-1412452604 Sep 06 01:18:21.229987 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Id: 1fa73b0bfee14a9ea25f03e523078995 Sep 06 01:18:21.229987 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1412452604 Sep 06 01:18:21.229987 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User: tempest-AttachVolumeNegativeTest-1412452604-project Sep 06 01:18:21.229987 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Id: default Sep 06 01:18:21.229987 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Name: Default Sep 06 01:18:21.229987 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Id: f8f44df824414e5ebc8cfd2126e9d66f Sep 06 01:18:21.229987 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Name: tempest-AttachVolumeNegativeTest-1412452604-project Sep 06 01:18:21.229987 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: method: > Sep 06 01:18:21.229987 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: exception: Instance a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 could not be found. Sep 06 01:18:21.229987 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: action_args: {'id': 'a23ae8e0-f66b-46e1-a6fe-ac890b3efe45'} Sep 06 01:18:21.230800 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:18:21.230800 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:21.230800 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 01:18:21.230800 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 01:18:21.230800 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 01:18:21.230800 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 01:18:21.230800 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 01:18:21.230800 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 01:18:21.230800 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 01:18:21.230800 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 01:18:21.230800 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 could not be found. Sep 06 01:18:21.230800 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:21.230800 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:21.230800 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:21.230800 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:21.230800 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:21.230800 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:21.230800 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:18:21.230800 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:18:21.230800 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:18:21.232036 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:18:21.232036 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 01:18:21.232036 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 01:18:21.232036 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 01:18:21.232036 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 01:18:21.232036 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 01:18:21.232036 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:18:21.232036 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 could not be found. Sep 06 01:18:21.232036 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:21.232036 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:21.232036 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:21.232036 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:21.232036 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:21.232036 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:21.232036 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:18:21.232036 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:18:21.232036 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 could not be found. Sep 06 01:18:21.232036 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:21.233217 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-aa04c8b3-7009-4137-8a16-cf46db51d7a6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Returning 404 to user: Instance a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 could not be found. {{(pid=120580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:18:21.233217 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-aa04c8b3-7009-4137-8a16-cf46db51d7a6 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45" status: 404 len: 111 microversion: 2.1 time: 0.030468 Sep 06 01:18:21.233217 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 508/982] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:18:21 2022] GET /compute/v2.1/servers/a23ae8e0-f66b-46e1-a6fe-ac890b3efe45 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 01:18:21.239903 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-7829fcee-7553-4013-a4d9-eb675b28e809 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:21.240542 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-7829fcee-7553-4013-a4d9-eb675b28e809 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:21.246627 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7829fcee-7553-4013-a4d9-eb675b28e809 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:21.246990 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7829fcee-7553-4013-a4d9-eb675b28e809 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:21.247420 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7829fcee-7553-4013-a4d9-eb675b28e809 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:21.248334 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7829fcee-7553-4013-a4d9-eb675b28e809 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:21.248570 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7829fcee-7553-4013-a4d9-eb675b28e809 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:21.249187 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7829fcee-7553-4013-a4d9-eb675b28e809 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:21.265377 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.wsgi [None req-7829fcee-7553-4013-a4d9-eb675b28e809 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] HTTP exception thrown: Instance f9a2a405-dce3-4320-b44d-a19c556501b5 could not be found. Sep 06 01:18:21.266934 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-7829fcee-7553-4013-a4d9-eb675b28e809 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Request method failure captured: Sep 06 01:18:21.266934 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: request: DELETE /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5 HTTP/1.1 Sep 06 01:18:21.266934 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept: application/json Sep 06 01:18:21.266934 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept-Encoding: identity Sep 06 01:18:21.266934 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Connection: close Sep 06 01:18:21.266934 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Length: 0 Sep 06 01:18:21.266934 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Type: application/json Sep 06 01:18:21.266934 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Host: 10.222.0.23 Sep 06 01:18:21.266934 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Openstack-System-Scope: None Sep 06 01:18:21.266934 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: User-Agent: python-urllib3/1.26.12 Sep 06 01:18:21.266934 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Auth-Token: gAAAAABjFp5HgEJZI7pOCAbhWXwWFE8yQ5t7K_Ws-jshDHbF7sXnYLPl16IIONgrpvYxWiZSDSAeitprugb5h17_eYSiBNUfLgmC9hbcnAOoP7NTvslLSb0CTURVLZpiFrwKL1VvcCbnqL_bQbP7LRSB17fvFEoXQ1dcjQQQPX7LNrOn0pG4F5A Sep 06 01:18:21.266934 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Id: None Sep 06 01:18:21.266934 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Name: None Sep 06 01:18:21.266934 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Identity-Status: Confirmed Sep 06 01:18:21.266934 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Is-Admin-Project: True Sep 06 01:18:21.266934 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Id: default Sep 06 01:18:21.266934 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Name: Default Sep 06 01:18:21.266934 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Id: 1fa73b0bfee14a9ea25f03e523078995 Sep 06 01:18:21.266934 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Name: tempest-AttachVolumeNegativeTest-1412452604 Sep 06 01:18:21.266934 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Role: reader,member Sep 06 01:18:21.266934 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Roles: reader,member Sep 06 01:18:21.268461 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1fa73b0bfee14a9ea25f03e523078995"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1fa73b0bfee14a9ea25f03e523078995"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1fa73b0bfee14a9ea25f03e523078995"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1fa73b0bfee14a9ea25f03e523078995"}]}] Sep 06 01:18:21.268461 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant: tempest-AttachVolumeNegativeTest-1412452604 Sep 06 01:18:21.268461 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Id: 1fa73b0bfee14a9ea25f03e523078995 Sep 06 01:18:21.268461 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1412452604 Sep 06 01:18:21.268461 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User: tempest-AttachVolumeNegativeTest-1412452604-project Sep 06 01:18:21.268461 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Id: default Sep 06 01:18:21.268461 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Name: Default Sep 06 01:18:21.268461 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Id: f8f44df824414e5ebc8cfd2126e9d66f Sep 06 01:18:21.268461 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Name: tempest-AttachVolumeNegativeTest-1412452604-project Sep 06 01:18:21.268461 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: method: > Sep 06 01:18:21.268461 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: exception: Instance f9a2a405-dce3-4320-b44d-a19c556501b5 could not be found. Sep 06 01:18:21.268461 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: action_args: {'id': 'f9a2a405-dce3-4320-b44d-a19c556501b5'} Sep 06 01:18:21.269346 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:18:21.269346 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:21.269346 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 01:18:21.269346 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 01:18:21.269346 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 01:18:21.269346 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 01:18:21.269346 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 01:18:21.269346 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 01:18:21.269346 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 01:18:21.269346 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 01:18:21.269346 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9a2a405-dce3-4320-b44d-a19c556501b5 could not be found. Sep 06 01:18:21.269346 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:21.269346 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:21.269346 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:21.269346 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:21.269346 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:21.269346 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:21.269346 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:18:21.269346 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:18:21.269346 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:18:21.270737 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:18:21.270737 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 01:18:21.270737 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 01:18:21.270737 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 01:18:21.270737 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 01:18:21.270737 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 01:18:21.270737 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 01:18:21.270737 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 01:18:21.270737 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:18:21.270737 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9a2a405-dce3-4320-b44d-a19c556501b5 could not be found. Sep 06 01:18:21.270737 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:21.270737 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:21.270737 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:21.270737 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:21.270737 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:21.270737 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:21.270737 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:18:21.270737 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:18:21.270737 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9a2a405-dce3-4320-b44d-a19c556501b5 could not be found. Sep 06 01:18:21.270737 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:21.272159 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-7829fcee-7553-4013-a4d9-eb675b28e809 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Returning 404 to user: Instance f9a2a405-dce3-4320-b44d-a19c556501b5 could not be found. {{(pid=120580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:18:21.272159 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-7829fcee-7553-4013-a4d9-eb675b28e809 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5" status: 404 len: 111 microversion: 2.1 time: 0.033069 Sep 06 01:18:21.272159 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 509/983] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 6 01:18:21 2022] DELETE /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 01:18:21.276777 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-dc500690-3749-4c72-b5e5-cf7f0eb7d7e2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:21.277383 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-dc500690-3749-4c72-b5e5-cf7f0eb7d7e2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: f9a2a405-dce3-4320-b44d-a19c556501b5] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:21.283074 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dc500690-3749-4c72-b5e5-cf7f0eb7d7e2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:21.283632 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dc500690-3749-4c72-b5e5-cf7f0eb7d7e2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:21.284027 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dc500690-3749-4c72-b5e5-cf7f0eb7d7e2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:21.285099 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dc500690-3749-4c72-b5e5-cf7f0eb7d7e2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:21.285556 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dc500690-3749-4c72-b5e5-cf7f0eb7d7e2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:21.286070 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-dc500690-3749-4c72-b5e5-cf7f0eb7d7e2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:21.300048 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.wsgi [None req-dc500690-3749-4c72-b5e5-cf7f0eb7d7e2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] HTTP exception thrown: Instance f9a2a405-dce3-4320-b44d-a19c556501b5 could not be found. Sep 06 01:18:21.302120 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-dc500690-3749-4c72-b5e5-cf7f0eb7d7e2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Request method failure captured: Sep 06 01:18:21.302120 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: request: GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5 HTTP/1.1 Sep 06 01:18:21.302120 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept: application/json Sep 06 01:18:21.302120 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept-Encoding: identity Sep 06 01:18:21.302120 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Connection: close Sep 06 01:18:21.302120 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Length: 0 Sep 06 01:18:21.302120 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Type: application/json Sep 06 01:18:21.302120 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Host: 10.222.0.23 Sep 06 01:18:21.302120 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Openstack-System-Scope: None Sep 06 01:18:21.302120 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: User-Agent: python-urllib3/1.26.12 Sep 06 01:18:21.302120 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Auth-Token: gAAAAABjFp5HgEJZI7pOCAbhWXwWFE8yQ5t7K_Ws-jshDHbF7sXnYLPl16IIONgrpvYxWiZSDSAeitprugb5h17_eYSiBNUfLgmC9hbcnAOoP7NTvslLSb0CTURVLZpiFrwKL1VvcCbnqL_bQbP7LRSB17fvFEoXQ1dcjQQQPX7LNrOn0pG4F5A Sep 06 01:18:21.302120 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Id: None Sep 06 01:18:21.302120 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Name: None Sep 06 01:18:21.302120 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Identity-Status: Confirmed Sep 06 01:18:21.302120 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Is-Admin-Project: True Sep 06 01:18:21.302120 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Id: default Sep 06 01:18:21.302120 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Name: Default Sep 06 01:18:21.302120 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Id: 1fa73b0bfee14a9ea25f03e523078995 Sep 06 01:18:21.302120 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Name: tempest-AttachVolumeNegativeTest-1412452604 Sep 06 01:18:21.302120 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Role: reader,member Sep 06 01:18:21.302120 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Roles: reader,member Sep 06 01:18:21.303687 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1fa73b0bfee14a9ea25f03e523078995"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1fa73b0bfee14a9ea25f03e523078995"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1fa73b0bfee14a9ea25f03e523078995"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1fa73b0bfee14a9ea25f03e523078995"}]}] Sep 06 01:18:21.303687 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant: tempest-AttachVolumeNegativeTest-1412452604 Sep 06 01:18:21.303687 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Id: 1fa73b0bfee14a9ea25f03e523078995 Sep 06 01:18:21.303687 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1412452604 Sep 06 01:18:21.303687 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User: tempest-AttachVolumeNegativeTest-1412452604-project Sep 06 01:18:21.303687 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Id: default Sep 06 01:18:21.303687 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Name: Default Sep 06 01:18:21.303687 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Id: f8f44df824414e5ebc8cfd2126e9d66f Sep 06 01:18:21.303687 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Name: tempest-AttachVolumeNegativeTest-1412452604-project Sep 06 01:18:21.303687 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: method: > Sep 06 01:18:21.303687 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: exception: Instance f9a2a405-dce3-4320-b44d-a19c556501b5 could not be found. Sep 06 01:18:21.303687 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: action_args: {'id': 'f9a2a405-dce3-4320-b44d-a19c556501b5'} Sep 06 01:18:21.304599 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:18:21.304599 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:21.304599 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 01:18:21.304599 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 01:18:21.304599 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 01:18:21.304599 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 01:18:21.304599 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 01:18:21.304599 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 01:18:21.304599 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 01:18:21.304599 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 01:18:21.304599 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9a2a405-dce3-4320-b44d-a19c556501b5 could not be found. Sep 06 01:18:21.304599 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:21.304599 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:21.304599 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:21.304599 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:21.304599 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:21.304599 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:21.304599 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:18:21.304599 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:18:21.304599 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:18:21.305995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:18:21.305995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 01:18:21.305995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 01:18:21.305995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 01:18:21.305995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 01:18:21.305995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 01:18:21.305995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:18:21.305995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9a2a405-dce3-4320-b44d-a19c556501b5 could not be found. Sep 06 01:18:21.305995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:21.305995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:21.305995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:21.305995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:21.305995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:21.305995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:21.305995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:18:21.305995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:18:21.305995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9a2a405-dce3-4320-b44d-a19c556501b5 could not be found. Sep 06 01:18:21.305995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:21.307238 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-dc500690-3749-4c72-b5e5-cf7f0eb7d7e2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Returning 404 to user: Instance f9a2a405-dce3-4320-b44d-a19c556501b5 could not be found. {{(pid=120580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:18:21.307238 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-dc500690-3749-4c72-b5e5-cf7f0eb7d7e2 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5" status: 404 len: 111 microversion: 2.1 time: 0.030587 Sep 06 01:18:21.307238 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 510/984] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:18:21 2022] GET /compute/v2.1/servers/f9a2a405-dce3-4320-b44d-a19c556501b5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 01:18:21.416495 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-49ebf14b-ae9d-4b68-aa89-687ae319f6ea tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:21.417089 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-49ebf14b-ae9d-4b68-aa89-687ae319f6ea tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: 1a77e639-92e6-4c82-888f-423ae3a0d290] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:21.431147 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-49ebf14b-ae9d-4b68-aa89-687ae319f6ea tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:21.431147 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-49ebf14b-ae9d-4b68-aa89-687ae319f6ea tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:21.431147 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-49ebf14b-ae9d-4b68-aa89-687ae319f6ea tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:21.431147 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-49ebf14b-ae9d-4b68-aa89-687ae319f6ea tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:21.431647 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-49ebf14b-ae9d-4b68-aa89-687ae319f6ea tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:21.431647 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-49ebf14b-ae9d-4b68-aa89-687ae319f6ea tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:21.452589 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-49ebf14b-ae9d-4b68-aa89-687ae319f6ea tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290/ips" status: 200 len: 145 microversion: 2.1 time: 0.356386 Sep 06 01:18:21.453147 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 475/985] 10.222.0.23 () {58 vars in 1248 bytes} [Tue Sep 6 01:18:21 2022] GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290/ips => generated 145 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:18:22.462086 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-41338e26-751d-4d5b-8390-c7c5c9d05f76 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:22.462587 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-41338e26-751d-4d5b-8390-c7c5c9d05f76 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:22.468646 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-41338e26-751d-4d5b-8390-c7c5c9d05f76 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:22.469137 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-41338e26-751d-4d5b-8390-c7c5c9d05f76 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:22.469574 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-41338e26-751d-4d5b-8390-c7c5c9d05f76 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:22.470596 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-41338e26-751d-4d5b-8390-c7c5c9d05f76 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:22.471384 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-41338e26-751d-4d5b-8390-c7c5c9d05f76 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:22.471859 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-41338e26-751d-4d5b-8390-c7c5c9d05f76 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:22.486200 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.wsgi [None req-41338e26-751d-4d5b-8390-c7c5c9d05f76 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] HTTP exception thrown: Instance b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e could not be found. Sep 06 01:18:22.488649 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-41338e26-751d-4d5b-8390-c7c5c9d05f76 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Request method failure captured: Sep 06 01:18:22.488649 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: request: DELETE /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e HTTP/1.1 Sep 06 01:18:22.488649 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept: application/json Sep 06 01:18:22.488649 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept-Encoding: identity Sep 06 01:18:22.488649 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Connection: close Sep 06 01:18:22.488649 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Length: 0 Sep 06 01:18:22.488649 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Type: application/json Sep 06 01:18:22.488649 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Host: 10.222.0.23 Sep 06 01:18:22.488649 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Openstack-System-Scope: None Sep 06 01:18:22.488649 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: User-Agent: python-urllib3/1.26.12 Sep 06 01:18:22.488649 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Auth-Token: gAAAAABjFp5HgEJZI7pOCAbhWXwWFE8yQ5t7K_Ws-jshDHbF7sXnYLPl16IIONgrpvYxWiZSDSAeitprugb5h17_eYSiBNUfLgmC9hbcnAOoP7NTvslLSb0CTURVLZpiFrwKL1VvcCbnqL_bQbP7LRSB17fvFEoXQ1dcjQQQPX7LNrOn0pG4F5A Sep 06 01:18:22.488649 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Id: None Sep 06 01:18:22.488649 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Name: None Sep 06 01:18:22.488649 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Identity-Status: Confirmed Sep 06 01:18:22.488649 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Is-Admin-Project: True Sep 06 01:18:22.488649 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Id: default Sep 06 01:18:22.488649 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Name: Default Sep 06 01:18:22.488649 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Id: 1fa73b0bfee14a9ea25f03e523078995 Sep 06 01:18:22.488649 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Name: tempest-AttachVolumeNegativeTest-1412452604 Sep 06 01:18:22.488649 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Role: reader,member Sep 06 01:18:22.488649 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Roles: reader,member Sep 06 01:18:22.490243 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1fa73b0bfee14a9ea25f03e523078995"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1fa73b0bfee14a9ea25f03e523078995"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1fa73b0bfee14a9ea25f03e523078995"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1fa73b0bfee14a9ea25f03e523078995"}]}] Sep 06 01:18:22.490243 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant: tempest-AttachVolumeNegativeTest-1412452604 Sep 06 01:18:22.490243 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Id: 1fa73b0bfee14a9ea25f03e523078995 Sep 06 01:18:22.490243 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1412452604 Sep 06 01:18:22.490243 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User: tempest-AttachVolumeNegativeTest-1412452604-project Sep 06 01:18:22.490243 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Id: default Sep 06 01:18:22.490243 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Name: Default Sep 06 01:18:22.490243 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Id: f8f44df824414e5ebc8cfd2126e9d66f Sep 06 01:18:22.490243 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Name: tempest-AttachVolumeNegativeTest-1412452604-project Sep 06 01:18:22.490243 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: method: > Sep 06 01:18:22.490243 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: exception: Instance b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e could not be found. Sep 06 01:18:22.490243 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: action_args: {'id': 'b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e'} Sep 06 01:18:22.490986 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:18:22.490986 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:22.490986 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 01:18:22.490986 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 01:18:22.490986 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 01:18:22.490986 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 01:18:22.490986 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 01:18:22.490986 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 01:18:22.490986 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 01:18:22.490986 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 01:18:22.490986 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e could not be found. Sep 06 01:18:22.490986 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:22.490986 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:22.490986 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:22.490986 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:22.490986 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:22.490986 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:22.490986 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:18:22.490986 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:18:22.490986 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:18:22.492430 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:18:22.492430 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 01:18:22.492430 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 01:18:22.492430 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 01:18:22.492430 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 01:18:22.492430 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 01:18:22.492430 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 01:18:22.492430 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 01:18:22.492430 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:18:22.492430 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e could not be found. Sep 06 01:18:22.492430 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:22.492430 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:22.492430 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:22.492430 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:22.492430 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:22.492430 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:22.492430 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:18:22.492430 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:18:22.492430 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e could not be found. Sep 06 01:18:22.492430 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:22.493773 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-41338e26-751d-4d5b-8390-c7c5c9d05f76 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Returning 404 to user: Instance b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e could not be found. {{(pid=120580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:18:22.493773 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-41338e26-751d-4d5b-8390-c7c5c9d05f76 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e" status: 404 len: 111 microversion: 2.1 time: 0.033678 Sep 06 01:18:22.493773 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 511/986] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 6 01:18:22 2022] DELETE /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 01:18:22.501733 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9669d698-431c-43d8-a0a5-e2e05f1fb6a1 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:22.502388 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9669d698-431c-43d8-a0a5-e2e05f1fb6a1 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] [instance: b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:22.504777 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:18:22.510236 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9669d698-431c-43d8-a0a5-e2e05f1fb6a1 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:22.510727 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9669d698-431c-43d8-a0a5-e2e05f1fb6a1 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:22.511176 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9669d698-431c-43d8-a0a5-e2e05f1fb6a1 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:22.511906 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9669d698-431c-43d8-a0a5-e2e05f1fb6a1 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:22.512369 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9669d698-431c-43d8-a0a5-e2e05f1fb6a1 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:22.512799 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9669d698-431c-43d8-a0a5-e2e05f1fb6a1 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:22.527659 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-9669d698-431c-43d8-a0a5-e2e05f1fb6a1 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] HTTP exception thrown: Instance b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e could not be found. Sep 06 01:18:22.529402 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9669d698-431c-43d8-a0a5-e2e05f1fb6a1 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Request method failure captured: Sep 06 01:18:22.529402 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e HTTP/1.1 Sep 06 01:18:22.529402 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept: application/json Sep 06 01:18:22.529402 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept-Encoding: identity Sep 06 01:18:22.529402 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Connection: close Sep 06 01:18:22.529402 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Length: 0 Sep 06 01:18:22.529402 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Type: application/json Sep 06 01:18:22.529402 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Host: 10.222.0.23 Sep 06 01:18:22.529402 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Openstack-System-Scope: None Sep 06 01:18:22.529402 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Sep 06 01:18:22.529402 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjFp5HgEJZI7pOCAbhWXwWFE8yQ5t7K_Ws-jshDHbF7sXnYLPl16IIONgrpvYxWiZSDSAeitprugb5h17_eYSiBNUfLgmC9hbcnAOoP7NTvslLSb0CTURVLZpiFrwKL1VvcCbnqL_bQbP7LRSB17fvFEoXQ1dcjQQQPX7LNrOn0pG4F5A Sep 06 01:18:22.529402 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Id: None Sep 06 01:18:22.529402 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Name: None Sep 06 01:18:22.529402 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Identity-Status: Confirmed Sep 06 01:18:22.529402 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Is-Admin-Project: True Sep 06 01:18:22.529402 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Id: default Sep 06 01:18:22.529402 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Name: Default Sep 06 01:18:22.529402 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Id: 1fa73b0bfee14a9ea25f03e523078995 Sep 06 01:18:22.529402 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Name: tempest-AttachVolumeNegativeTest-1412452604 Sep 06 01:18:22.529402 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Role: reader,member Sep 06 01:18:22.529402 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Roles: reader,member Sep 06 01:18:22.531053 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1fa73b0bfee14a9ea25f03e523078995"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1fa73b0bfee14a9ea25f03e523078995"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1fa73b0bfee14a9ea25f03e523078995"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1fa73b0bfee14a9ea25f03e523078995"}]}] Sep 06 01:18:22.531053 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant: tempest-AttachVolumeNegativeTest-1412452604 Sep 06 01:18:22.531053 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Id: 1fa73b0bfee14a9ea25f03e523078995 Sep 06 01:18:22.531053 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1412452604 Sep 06 01:18:22.531053 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User: tempest-AttachVolumeNegativeTest-1412452604-project Sep 06 01:18:22.531053 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Id: default Sep 06 01:18:22.531053 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Name: Default Sep 06 01:18:22.531053 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Id: f8f44df824414e5ebc8cfd2126e9d66f Sep 06 01:18:22.531053 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Name: tempest-AttachVolumeNegativeTest-1412452604-project Sep 06 01:18:22.531053 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: method: > Sep 06 01:18:22.531053 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: exception: Instance b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e could not be found. Sep 06 01:18:22.531053 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: action_args: {'id': 'b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e'} Sep 06 01:18:22.531916 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:18:22.531916 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:22.531916 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 01:18:22.531916 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 01:18:22.531916 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 01:18:22.531916 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 01:18:22.531916 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 01:18:22.531916 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 01:18:22.531916 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 01:18:22.531916 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 01:18:22.531916 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e could not be found. Sep 06 01:18:22.531916 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:22.531916 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:22.531916 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:22.531916 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:22.531916 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:22.531916 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:22.531916 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:18:22.531916 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:18:22.531916 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:18:22.533340 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:18:22.533340 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 01:18:22.533340 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 01:18:22.533340 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 01:18:22.533340 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 01:18:22.533340 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 01:18:22.533340 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:18:22.533340 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e could not be found. Sep 06 01:18:22.533340 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:22.533340 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:22.533340 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:22.533340 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:22.533340 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:22.533340 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:22.533340 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:18:22.533340 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:18:22.533340 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e could not be found. Sep 06 01:18:22.533340 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:22.535342 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9669d698-431c-43d8-a0a5-e2e05f1fb6a1 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] Returning 404 to user: Instance b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:18:22.535342 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9669d698-431c-43d8-a0a5-e2e05f1fb6a1 tempest-AttachVolumeNegativeTest-1412452604 tempest-AttachVolumeNegativeTest-1412452604-project] 10.222.0.23 "GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e" status: 404 len: 111 microversion: 2.1 time: 0.034386 Sep 06 01:18:22.535342 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 476/987] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:18:22 2022] GET /compute/v2.1/servers/b8fb4ea7-ee93-4ff0-aeb7-ae9d1762d43e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 01:18:22.814512 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-3837a239-4bc4-40d6-bb83-36febe762877 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f3cb0fb7-ea31-4604-8090-89c4338397df"}} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:18:22.817071 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-3837a239-4bc4-40d6-bb83-36febe762877 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: 1a77e639-92e6-4c82-888f-423ae3a0d290] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:22.823007 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3837a239-4bc4-40d6-bb83-36febe762877 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:22.823608 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3837a239-4bc4-40d6-bb83-36febe762877 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:22.824163 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3837a239-4bc4-40d6-bb83-36febe762877 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:22.824959 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3837a239-4bc4-40d6-bb83-36febe762877 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:22.825540 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3837a239-4bc4-40d6-bb83-36febe762877 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:22.826081 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3837a239-4bc4-40d6-bb83-36febe762877 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:23.128845 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-3837a239-4bc4-40d6-bb83-36febe762877 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "POST /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.317774 Sep 06 01:18:23.134866 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 512/988] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Sep 6 01:18:22 2022] POST /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290/os-volume_attachments => generated 194 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:18:27.115222 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3cafdcda-f6dd-431c-a1ea-5202af1f8b8f tempest-VolumesNegativeTest-1301784528 tempest-VolumesNegativeTest-1301784528-project] Action: 'create', calling method: .version_select at 0x7fb06e251550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1866497911", "metadata": {"Type": "work"}}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:18:27.126759 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3cafdcda-f6dd-431c-a1ea-5202af1f8b8f tempest-VolumesNegativeTest-1301784528 tempest-VolumesNegativeTest-1301784528-project] Request method failure captured: Sep 06 01:18:27.126759 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 06 01:18:27.126759 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept: application/json Sep 06 01:18:27.126759 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept-Encoding: identity Sep 06 01:18:27.126759 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Connection: close Sep 06 01:18:27.126759 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Length: 122 Sep 06 01:18:27.126759 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Type: application/json Sep 06 01:18:27.126759 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Host: 10.222.0.23 Sep 06 01:18:27.126759 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Openstack-System-Scope: None Sep 06 01:18:27.126759 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Sep 06 01:18:27.126759 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjFp_iBFT-zLeUiBrGnHKZe0U8S7jUm_43px7K6z6sB-024dYZgthXAghRkhXin7UAQf-cQLko58IFUZB4F_Qdg6CWRTp87sxOJ-Bsb_MOFMJkZ-arEhPtvro2inIxXjH2Z8sXtXY1Vsf6bnY6pjxC6kfuD847ba_EF_GYp9IVIogroTU Sep 06 01:18:27.126759 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Id: None Sep 06 01:18:27.126759 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Name: None Sep 06 01:18:27.126759 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Identity-Status: Confirmed Sep 06 01:18:27.126759 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Is-Admin-Project: True Sep 06 01:18:27.126759 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Id: default Sep 06 01:18:27.126759 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Name: Default Sep 06 01:18:27.126759 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Id: 4c485dab58fc4232844ddf88a3643f00 Sep 06 01:18:27.126759 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Name: tempest-VolumesNegativeTest-1301784528 Sep 06 01:18:27.126759 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Role: reader,member Sep 06 01:18:27.126759 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Roles: reader,member Sep 06 01:18:27.129060 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4c485dab58fc4232844ddf88a3643f00"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4c485dab58fc4232844ddf88a3643f00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4c485dab58fc4232844ddf88a3643f00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4c485dab58fc4232844ddf88a3643f00"}]}] Sep 06 01:18:27.129060 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant: tempest-VolumesNegativeTest-1301784528 Sep 06 01:18:27.129060 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Id: 4c485dab58fc4232844ddf88a3643f00 Sep 06 01:18:27.129060 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Name: tempest-VolumesNegativeTest-1301784528 Sep 06 01:18:27.129060 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User: tempest-VolumesNegativeTest-1301784528-project Sep 06 01:18:27.129060 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Id: default Sep 06 01:18:27.129060 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Name: Default Sep 06 01:18:27.129060 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Id: a09a955033a04334987567274e2fe344 Sep 06 01:18:27.129060 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Name: tempest-VolumesNegativeTest-1301784528-project Sep 06 01:18:27.129060 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Sep 06 01:18:27.129060 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1866497911", "metadata": {"Type": "work"}}} Sep 06 01:18:27.129060 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: method: Sep 06 01:18:27.129060 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 06 01:18:27.130236 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1866497911', 'metadata': {'Type': 'work'}}}} Sep 06 01:18:27.130236 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:18:27.130236 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:27.130236 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 01:18:27.130236 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 01:18:27.130236 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 01:18:27.130236 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise error Sep 06 01:18:27.130236 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 06 01:18:27.130236 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:27.130236 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 06 01:18:27.130236 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 06 01:18:27.130236 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:27.130236 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 06 01:18:27.130236 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi '#$%' Sep 06 01:18:27.130236 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:27.130236 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:27.130236 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:27.130236 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:27.130236 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:27.130236 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:27.130236 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:18:27.130236 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:18:27.131820 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 01:18:27.131820 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 01:18:27.131820 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:18:27.131820 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:18:27.131820 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 01:18:27.131820 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 01:18:27.131820 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 01:18:27.131820 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 01:18:27.131820 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 01:18:27.131820 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 01:18:27.131820 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 06 01:18:27.131820 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:27.131820 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:27.131820 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:27.131820 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:27.131820 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:27.131820 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:27.131820 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 01:18:27.131820 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 01:18:27.133070 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 06 01:18:27.133070 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:27.133070 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3cafdcda-f6dd-431c-a1ea-5202af1f8b8f tempest-VolumesNegativeTest-1301784528 tempest-VolumesNegativeTest-1301784528-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:18:27.133070 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3cafdcda-f6dd-431c-a1ea-5202af1f8b8f tempest-VolumesNegativeTest-1301784528 tempest-VolumesNegativeTest-1301784528-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.147800 Sep 06 01:18:27.133070 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 477/989] 10.222.0.23 () {60 vars in 1156 bytes} [Tue Sep 6 01:18:26 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 149 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 01:18:27.140674 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-c959979f-6e4a-432a-bf9f-185fe1175959 tempest-VolumesNegativeTest-1301784528 tempest-VolumesNegativeTest-1301784528-project] Action: 'create', calling method: .version_select at 0x7fb06df719d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-582727153", "metadata": {"Type": "work"}}} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:18:27.145991 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-c959979f-6e4a-432a-bf9f-185fe1175959 tempest-VolumesNegativeTest-1301784528 tempest-VolumesNegativeTest-1301784528-project] Request method failure captured: Sep 06 01:18:27.145991 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 06 01:18:27.145991 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept: application/json Sep 06 01:18:27.145991 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept-Encoding: identity Sep 06 01:18:27.145991 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Connection: close Sep 06 01:18:27.145991 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Length: 119 Sep 06 01:18:27.145991 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Type: application/json Sep 06 01:18:27.145991 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Host: 10.222.0.23 Sep 06 01:18:27.145991 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Openstack-System-Scope: None Sep 06 01:18:27.145991 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: User-Agent: python-urllib3/1.26.12 Sep 06 01:18:27.145991 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Auth-Token: gAAAAABjFp_iBFT-zLeUiBrGnHKZe0U8S7jUm_43px7K6z6sB-024dYZgthXAghRkhXin7UAQf-cQLko58IFUZB4F_Qdg6CWRTp87sxOJ-Bsb_MOFMJkZ-arEhPtvro2inIxXjH2Z8sXtXY1Vsf6bnY6pjxC6kfuD847ba_EF_GYp9IVIogroTU Sep 06 01:18:27.145991 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Id: None Sep 06 01:18:27.145991 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Name: None Sep 06 01:18:27.145991 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Identity-Status: Confirmed Sep 06 01:18:27.145991 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Is-Admin-Project: True Sep 06 01:18:27.145991 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Id: default Sep 06 01:18:27.145991 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Name: Default Sep 06 01:18:27.145991 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Id: 4c485dab58fc4232844ddf88a3643f00 Sep 06 01:18:27.145991 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Name: tempest-VolumesNegativeTest-1301784528 Sep 06 01:18:27.145991 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Role: reader,member Sep 06 01:18:27.145991 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Roles: reader,member Sep 06 01:18:27.147566 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4c485dab58fc4232844ddf88a3643f00"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4c485dab58fc4232844ddf88a3643f00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4c485dab58fc4232844ddf88a3643f00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4c485dab58fc4232844ddf88a3643f00"}]}] Sep 06 01:18:27.147566 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant: tempest-VolumesNegativeTest-1301784528 Sep 06 01:18:27.147566 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Id: 4c485dab58fc4232844ddf88a3643f00 Sep 06 01:18:27.147566 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Name: tempest-VolumesNegativeTest-1301784528 Sep 06 01:18:27.147566 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User: tempest-VolumesNegativeTest-1301784528-project Sep 06 01:18:27.147566 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Id: default Sep 06 01:18:27.147566 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Name: Default Sep 06 01:18:27.147566 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Id: a09a955033a04334987567274e2fe344 Sep 06 01:18:27.147566 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Name: tempest-VolumesNegativeTest-1301784528-project Sep 06 01:18:27.147566 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Sep 06 01:18:27.147566 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-582727153", "metadata": {"Type": "work"}}} Sep 06 01:18:27.147566 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: method: Sep 06 01:18:27.147566 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 06 01:18:27.148476 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-582727153', 'metadata': {'Type': 'work'}}}} Sep 06 01:18:27.148476 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:18:27.148476 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:27.148476 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 01:18:27.148476 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 01:18:27.148476 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 01:18:27.148476 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise error Sep 06 01:18:27.148476 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 06 01:18:27.148476 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:27.148476 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 06 01:18:27.148476 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 06 01:18:27.148476 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:27.148476 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 06 01:18:27.148476 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi '0' Sep 06 01:18:27.148476 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:27.148476 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:27.148476 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:27.148476 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:27.148476 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:27.148476 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:27.148476 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:18:27.148476 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:18:27.150009 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 01:18:27.150009 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 01:18:27.150009 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:18:27.150009 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:18:27.150009 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 01:18:27.150009 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 01:18:27.150009 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 01:18:27.150009 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 01:18:27.150009 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 01:18:27.150009 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 01:18:27.150009 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 06 01:18:27.150009 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:27.150009 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:27.150009 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:27.150009 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:27.150009 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:27.150009 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:27.150009 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 01:18:27.150009 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 01:18:27.151349 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 06 01:18:27.151349 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:27.151349 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-c959979f-6e4a-432a-bf9f-185fe1175959 tempest-VolumesNegativeTest-1301784528 tempest-VolumesNegativeTest-1301784528-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:18:27.151349 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-c959979f-6e4a-432a-bf9f-185fe1175959 tempest-VolumesNegativeTest-1301784528 tempest-VolumesNegativeTest-1301784528-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011967 Sep 06 01:18:27.151349 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 513/990] 10.222.0.23 () {60 vars in 1156 bytes} [Tue Sep 6 01:18:27 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 06 01:18:27.158202 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d29d0f25-c027-4106-ab5e-42500ec2c82f tempest-VolumesNegativeTest-1301784528 tempest-VolumesNegativeTest-1301784528-project] Action: 'create', calling method: .version_select at 0x7fb06f9bd8b0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-785070004", "metadata": {"Type": "work"}}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:18:27.164057 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d29d0f25-c027-4106-ab5e-42500ec2c82f tempest-VolumesNegativeTest-1301784528 tempest-VolumesNegativeTest-1301784528-project] Request method failure captured: Sep 06 01:18:27.164057 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 06 01:18:27.164057 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept: application/json Sep 06 01:18:27.164057 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept-Encoding: identity Sep 06 01:18:27.164057 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Connection: close Sep 06 01:18:27.164057 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Length: 118 Sep 06 01:18:27.164057 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Type: application/json Sep 06 01:18:27.164057 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Host: 10.222.0.23 Sep 06 01:18:27.164057 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Openstack-System-Scope: None Sep 06 01:18:27.164057 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Sep 06 01:18:27.164057 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjFp_iBFT-zLeUiBrGnHKZe0U8S7jUm_43px7K6z6sB-024dYZgthXAghRkhXin7UAQf-cQLko58IFUZB4F_Qdg6CWRTp87sxOJ-Bsb_MOFMJkZ-arEhPtvro2inIxXjH2Z8sXtXY1Vsf6bnY6pjxC6kfuD847ba_EF_GYp9IVIogroTU Sep 06 01:18:27.164057 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Id: None Sep 06 01:18:27.164057 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Name: None Sep 06 01:18:27.164057 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Identity-Status: Confirmed Sep 06 01:18:27.164057 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Is-Admin-Project: True Sep 06 01:18:27.164057 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Id: default Sep 06 01:18:27.164057 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Name: Default Sep 06 01:18:27.164057 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Id: 4c485dab58fc4232844ddf88a3643f00 Sep 06 01:18:27.164057 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Name: tempest-VolumesNegativeTest-1301784528 Sep 06 01:18:27.164057 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Role: reader,member Sep 06 01:18:27.164057 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Roles: reader,member Sep 06 01:18:27.165477 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4c485dab58fc4232844ddf88a3643f00"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4c485dab58fc4232844ddf88a3643f00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4c485dab58fc4232844ddf88a3643f00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4c485dab58fc4232844ddf88a3643f00"}]}] Sep 06 01:18:27.165477 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant: tempest-VolumesNegativeTest-1301784528 Sep 06 01:18:27.165477 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Id: 4c485dab58fc4232844ddf88a3643f00 Sep 06 01:18:27.165477 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Name: tempest-VolumesNegativeTest-1301784528 Sep 06 01:18:27.165477 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User: tempest-VolumesNegativeTest-1301784528-project Sep 06 01:18:27.165477 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Id: default Sep 06 01:18:27.165477 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Name: Default Sep 06 01:18:27.165477 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Id: a09a955033a04334987567274e2fe344 Sep 06 01:18:27.165477 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Name: tempest-VolumesNegativeTest-1301784528-project Sep 06 01:18:27.165477 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Sep 06 01:18:27.165477 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-785070004", "metadata": {"Type": "work"}}} Sep 06 01:18:27.165477 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: method: Sep 06 01:18:27.165477 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 06 01:18:27.166525 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-785070004', 'metadata': {'Type': 'work'}}}} Sep 06 01:18:27.166525 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:18:27.166525 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:27.166525 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 01:18:27.166525 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 01:18:27.166525 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 01:18:27.166525 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise error Sep 06 01:18:27.166525 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 06 01:18:27.166525 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:27.166525 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 06 01:18:27.166525 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 06 01:18:27.166525 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:27.166525 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 06 01:18:27.166525 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi '' Sep 06 01:18:27.166525 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:27.166525 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:27.166525 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:27.166525 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:27.166525 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:27.166525 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:27.166525 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:18:27.166525 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:18:27.168905 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 01:18:27.168905 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 01:18:27.168905 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:18:27.168905 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:18:27.168905 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 01:18:27.168905 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 01:18:27.168905 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 01:18:27.168905 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 01:18:27.168905 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 01:18:27.168905 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 01:18:27.168905 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 06 01:18:27.168905 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:27.168905 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:27.168905 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:27.168905 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:27.168905 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:27.168905 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:27.168905 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 01:18:27.168905 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 01:18:27.170568 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 06 01:18:27.170568 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:27.170568 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d29d0f25-c027-4106-ab5e-42500ec2c82f tempest-VolumesNegativeTest-1301784528 tempest-VolumesNegativeTest-1301784528-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:18:27.170568 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d29d0f25-c027-4106-ab5e-42500ec2c82f tempest-VolumesNegativeTest-1301784528 tempest-VolumesNegativeTest-1301784528-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012321 Sep 06 01:18:27.170568 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 478/991] 10.222.0.23 () {60 vars in 1156 bytes} [Tue Sep 6 01:18:27 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 01:18:27.180079 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-9ecd6c2d-eb32-4369-a56c-871d8921af3b tempest-VolumesNegativeTest-1301784528 tempest-VolumesNegativeTest-1301784528-project] Calling method '.version_select at 0x7fb06e18d280>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:27.214361 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.wsgi [None req-9ecd6c2d-eb32-4369-a56c-871d8921af3b tempest-VolumesNegativeTest-1301784528 tempest-VolumesNegativeTest-1301784528-project] HTTP exception thrown: Volume tempest-invalid-1160018293 could not be found. Sep 06 01:18:27.216294 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-9ecd6c2d-eb32-4369-a56c-871d8921af3b tempest-VolumesNegativeTest-1301784528 tempest-VolumesNegativeTest-1301784528-project] Request method failure captured: Sep 06 01:18:27.216294 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1160018293 HTTP/1.1 Sep 06 01:18:27.216294 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept: application/json Sep 06 01:18:27.216294 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept-Encoding: identity Sep 06 01:18:27.216294 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Connection: close Sep 06 01:18:27.216294 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Length: 0 Sep 06 01:18:27.216294 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Type: application/json Sep 06 01:18:27.216294 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Host: 10.222.0.23 Sep 06 01:18:27.216294 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Openstack-System-Scope: None Sep 06 01:18:27.216294 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: User-Agent: python-urllib3/1.26.12 Sep 06 01:18:27.216294 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Auth-Token: gAAAAABjFp_iBFT-zLeUiBrGnHKZe0U8S7jUm_43px7K6z6sB-024dYZgthXAghRkhXin7UAQf-cQLko58IFUZB4F_Qdg6CWRTp87sxOJ-Bsb_MOFMJkZ-arEhPtvro2inIxXjH2Z8sXtXY1Vsf6bnY6pjxC6kfuD847ba_EF_GYp9IVIogroTU Sep 06 01:18:27.216294 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Id: None Sep 06 01:18:27.216294 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Name: None Sep 06 01:18:27.216294 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Identity-Status: Confirmed Sep 06 01:18:27.216294 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Is-Admin-Project: True Sep 06 01:18:27.216294 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Id: default Sep 06 01:18:27.216294 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Name: Default Sep 06 01:18:27.216294 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Id: 4c485dab58fc4232844ddf88a3643f00 Sep 06 01:18:27.216294 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Name: tempest-VolumesNegativeTest-1301784528 Sep 06 01:18:27.216294 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Role: reader,member Sep 06 01:18:27.216294 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Roles: reader,member Sep 06 01:18:27.217893 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4c485dab58fc4232844ddf88a3643f00"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4c485dab58fc4232844ddf88a3643f00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4c485dab58fc4232844ddf88a3643f00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4c485dab58fc4232844ddf88a3643f00"}]}] Sep 06 01:18:27.217893 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant: tempest-VolumesNegativeTest-1301784528 Sep 06 01:18:27.217893 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Id: 4c485dab58fc4232844ddf88a3643f00 Sep 06 01:18:27.217893 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Name: tempest-VolumesNegativeTest-1301784528 Sep 06 01:18:27.217893 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User: tempest-VolumesNegativeTest-1301784528-project Sep 06 01:18:27.217893 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Id: default Sep 06 01:18:27.217893 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Name: Default Sep 06 01:18:27.217893 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Id: a09a955033a04334987567274e2fe344 Sep 06 01:18:27.217893 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Name: tempest-VolumesNegativeTest-1301784528-project Sep 06 01:18:27.217893 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: method: Sep 06 01:18:27.217893 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: exception: Volume tempest-invalid-1160018293 could not be found. Sep 06 01:18:27.217893 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: action_args: {'id': 'tempest-invalid-1160018293'} Sep 06 01:18:27.217893 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:18:27.218790 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:27.218790 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 01:18:27.218790 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 01:18:27.218790 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 01:18:27.218790 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 01:18:27.218790 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 01:18:27.218790 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 01:18:27.218790 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 01:18:27.218790 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 01:18:27.218790 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 01:18:27.218790 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 01:18:27.218790 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 01:18:27.218790 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 01:18:27.218790 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 01:18:27.218790 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 01:18:27.218790 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1160018293 could not be found. (HTTP 404) (Request-ID: req-b0b79d58-ff6a-4ba9-bd7b-16ba820d45b1) Sep 06 01:18:27.218790 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:27.218790 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:27.218790 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:27.220219 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:27.220219 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 06 01:18:27.220219 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 06 01:18:27.220219 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 01:18:27.220219 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 01:18:27.220219 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 01:18:27.220219 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 01:18:27.220219 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 01:18:27.220219 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 01:18:27.220219 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 01:18:27.220219 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 01:18:27.220219 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 01:18:27.220219 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 01:18:27.220219 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 01:18:27.220219 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 01:18:27.220219 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 01:18:27.220219 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 01:18:27.220219 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 01:18:27.220219 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 01:18:27.223313 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 01:18:27.223313 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 01:18:27.223313 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 01:18:27.223313 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 01:18:27.223313 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1160018293 could not be found. Sep 06 01:18:27.223313 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:27.223313 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:27.223313 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:27.223313 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:27.223313 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:27.223313 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:27.223313 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:18:27.223313 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:18:27.223313 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 01:18:27.223313 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 01:18:27.223313 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:18:27.223313 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:18:27.223313 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 06 01:18:27.223313 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:18:27.223313 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1160018293 could not be found. Sep 06 01:18:27.224756 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:27.224756 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:27.224756 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:27.224756 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:27.224756 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:27.224756 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:27.224756 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:18:27.224756 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:18:27.224756 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1160018293 could not be found. Sep 06 01:18:27.224756 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:27.224756 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-9ecd6c2d-eb32-4369-a56c-871d8921af3b tempest-VolumesNegativeTest-1301784528 tempest-VolumesNegativeTest-1301784528-project] Returning 404 to user: Volume tempest-invalid-1160018293 could not be found. {{(pid=120580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:18:27.224756 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-9ecd6c2d-eb32-4369-a56c-871d8921af3b tempest-VolumesNegativeTest-1301784528 tempest-VolumesNegativeTest-1301784528-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1160018293" status: 404 len: 99 microversion: 2.1 time: 0.043263 Sep 06 01:18:27.224756 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 514/992] 10.222.0.23 () {58 vars in 1218 bytes} [Tue Sep 6 01:18:27 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1160018293 => generated 99 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 01:18:27.228641 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6c1333e2-b63f-4894-b86e-1af38ccda611 tempest-VolumesNegativeTest-1301784528 tempest-VolumesNegativeTest-1301784528-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004289 Sep 06 01:18:27.229132 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 479/993] 10.222.0.23 () {58 vars in 1140 bytes} [Tue Sep 6 01:18:27 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 06 01:18:27.237867 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-35fd3e27-a3ed-41bc-950d-227c5c5ec033 tempest-VolumesNegativeTest-1301784528 tempest-VolumesNegativeTest-1301784528-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003900 Sep 06 01:18:27.238354 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 515/994] 10.222.0.23 () {58 vars in 1137 bytes} [Tue Sep 6 01:18:27 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 06 01:18:27.247036 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-69acb81a-da38-4941-ac09-1a626d2f9abe tempest-VolumesNegativeTest-1301784528 tempest-VolumesNegativeTest-1301784528-project] Calling method '.version_select at 0x7fb06e251700>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:27.276157 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-69acb81a-da38-4941-ac09-1a626d2f9abe tempest-VolumesNegativeTest-1301784528 tempest-VolumesNegativeTest-1301784528-project] HTTP exception thrown: Volume 012a2c4e-ce7e-4668-bcc4-417b4ba558a0 could not be found. Sep 06 01:18:27.278250 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-69acb81a-da38-4941-ac09-1a626d2f9abe tempest-VolumesNegativeTest-1301784528 tempest-VolumesNegativeTest-1301784528-project] Request method failure captured: Sep 06 01:18:27.278250 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: request: DELETE /compute/v2.1/os-volumes/012a2c4e-ce7e-4668-bcc4-417b4ba558a0 HTTP/1.1 Sep 06 01:18:27.278250 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept: application/json Sep 06 01:18:27.278250 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept-Encoding: identity Sep 06 01:18:27.278250 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Connection: close Sep 06 01:18:27.278250 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Length: 0 Sep 06 01:18:27.278250 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Type: application/json Sep 06 01:18:27.278250 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Host: 10.222.0.23 Sep 06 01:18:27.278250 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Openstack-System-Scope: None Sep 06 01:18:27.278250 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Sep 06 01:18:27.278250 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjFp_iBFT-zLeUiBrGnHKZe0U8S7jUm_43px7K6z6sB-024dYZgthXAghRkhXin7UAQf-cQLko58IFUZB4F_Qdg6CWRTp87sxOJ-Bsb_MOFMJkZ-arEhPtvro2inIxXjH2Z8sXtXY1Vsf6bnY6pjxC6kfuD847ba_EF_GYp9IVIogroTU Sep 06 01:18:27.278250 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Id: None Sep 06 01:18:27.278250 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Name: None Sep 06 01:18:27.278250 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Identity-Status: Confirmed Sep 06 01:18:27.278250 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Is-Admin-Project: True Sep 06 01:18:27.278250 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Id: default Sep 06 01:18:27.278250 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Name: Default Sep 06 01:18:27.278250 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Id: 4c485dab58fc4232844ddf88a3643f00 Sep 06 01:18:27.278250 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Name: tempest-VolumesNegativeTest-1301784528 Sep 06 01:18:27.278250 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Role: reader,member Sep 06 01:18:27.278250 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Roles: reader,member Sep 06 01:18:27.279841 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4c485dab58fc4232844ddf88a3643f00"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4c485dab58fc4232844ddf88a3643f00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4c485dab58fc4232844ddf88a3643f00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4c485dab58fc4232844ddf88a3643f00"}]}] Sep 06 01:18:27.279841 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant: tempest-VolumesNegativeTest-1301784528 Sep 06 01:18:27.279841 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Id: 4c485dab58fc4232844ddf88a3643f00 Sep 06 01:18:27.279841 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Name: tempest-VolumesNegativeTest-1301784528 Sep 06 01:18:27.279841 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User: tempest-VolumesNegativeTest-1301784528-project Sep 06 01:18:27.279841 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Id: default Sep 06 01:18:27.279841 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Name: Default Sep 06 01:18:27.279841 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Id: a09a955033a04334987567274e2fe344 Sep 06 01:18:27.279841 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Name: tempest-VolumesNegativeTest-1301784528-project Sep 06 01:18:27.279841 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: method: Sep 06 01:18:27.279841 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: exception: Volume 012a2c4e-ce7e-4668-bcc4-417b4ba558a0 could not be found. Sep 06 01:18:27.279841 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: action_args: {'id': '012a2c4e-ce7e-4668-bcc4-417b4ba558a0'} Sep 06 01:18:27.279841 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:18:27.280797 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:27.280797 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 01:18:27.280797 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 01:18:27.280797 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 01:18:27.280797 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 01:18:27.280797 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 01:18:27.280797 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 01:18:27.280797 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 01:18:27.280797 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 01:18:27.280797 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 01:18:27.280797 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 01:18:27.280797 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 01:18:27.280797 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 01:18:27.280797 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 01:18:27.280797 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 01:18:27.280797 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 012a2c4e-ce7e-4668-bcc4-417b4ba558a0 could not be found. (HTTP 404) (Request-ID: req-e827b15a-823e-45fd-8dae-d6bdde82df51) Sep 06 01:18:27.280797 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:27.280797 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:27.280797 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:27.282175 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:27.282175 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 06 01:18:27.282175 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 06 01:18:27.282175 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 01:18:27.282175 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 01:18:27.282175 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 01:18:27.282175 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 01:18:27.282175 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 01:18:27.282175 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 01:18:27.282175 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 01:18:27.282175 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 01:18:27.282175 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 01:18:27.282175 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 01:18:27.282175 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 01:18:27.282175 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 01:18:27.282175 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 01:18:27.282175 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 01:18:27.282175 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 01:18:27.282175 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 01:18:27.285133 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 01:18:27.285133 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 01:18:27.285133 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 01:18:27.285133 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 01:18:27.285133 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 012a2c4e-ce7e-4668-bcc4-417b4ba558a0 could not be found. Sep 06 01:18:27.285133 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:27.285133 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:27.285133 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:27.285133 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:27.285133 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:27.285133 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:27.285133 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:18:27.285133 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:18:27.285133 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 01:18:27.285133 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 01:18:27.285133 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:18:27.285133 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:18:27.285133 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 06 01:18:27.285133 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:18:27.286921 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 012a2c4e-ce7e-4668-bcc4-417b4ba558a0 could not be found. Sep 06 01:18:27.286921 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:27.286921 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:27.286921 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:27.286921 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:27.286921 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:27.286921 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:27.286921 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:18:27.286921 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:18:27.286921 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 012a2c4e-ce7e-4668-bcc4-417b4ba558a0 could not be found. Sep 06 01:18:27.286921 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:27.286921 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-69acb81a-da38-4941-ac09-1a626d2f9abe tempest-VolumesNegativeTest-1301784528 tempest-VolumesNegativeTest-1301784528-project] Returning 404 to user: Volume 012a2c4e-ce7e-4668-bcc4-417b4ba558a0 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:18:27.286921 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-69acb81a-da38-4941-ac09-1a626d2f9abe tempest-VolumesNegativeTest-1301784528 tempest-VolumesNegativeTest-1301784528-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/012a2c4e-ce7e-4668-bcc4-417b4ba558a0" status: 404 len: 109 microversion: 2.1 time: 0.036508 Sep 06 01:18:27.286921 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 480/995] 10.222.0.23 () {58 vars in 1248 bytes} [Tue Sep 6 01:18:27 2022] DELETE /compute/v2.1/os-volumes/012a2c4e-ce7e-4668-bcc4-417b4ba558a0 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 01:18:27.289685 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-8b3e8834-46f7-4aa9-9b6b-151fe99c8dcb tempest-VolumesNegativeTest-1301784528 tempest-VolumesNegativeTest-1301784528-project] Calling method '.version_select at 0x7fb06e20d310>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:27.316936 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.wsgi [None req-8b3e8834-46f7-4aa9-9b6b-151fe99c8dcb tempest-VolumesNegativeTest-1301784528 tempest-VolumesNegativeTest-1301784528-project] HTTP exception thrown: Volume 3cd8b7f4-615c-4b0a-ba88-161971a00104 could not be found. Sep 06 01:18:27.318953 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-8b3e8834-46f7-4aa9-9b6b-151fe99c8dcb tempest-VolumesNegativeTest-1301784528 tempest-VolumesNegativeTest-1301784528-project] Request method failure captured: Sep 06 01:18:27.318953 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: request: GET /compute/v2.1/os-volumes/3cd8b7f4-615c-4b0a-ba88-161971a00104 HTTP/1.1 Sep 06 01:18:27.318953 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept: application/json Sep 06 01:18:27.318953 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept-Encoding: identity Sep 06 01:18:27.318953 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Connection: close Sep 06 01:18:27.318953 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Length: 0 Sep 06 01:18:27.318953 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Type: application/json Sep 06 01:18:27.318953 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Host: 10.222.0.23 Sep 06 01:18:27.318953 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Openstack-System-Scope: None Sep 06 01:18:27.318953 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: User-Agent: python-urllib3/1.26.12 Sep 06 01:18:27.318953 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Auth-Token: gAAAAABjFp_iBFT-zLeUiBrGnHKZe0U8S7jUm_43px7K6z6sB-024dYZgthXAghRkhXin7UAQf-cQLko58IFUZB4F_Qdg6CWRTp87sxOJ-Bsb_MOFMJkZ-arEhPtvro2inIxXjH2Z8sXtXY1Vsf6bnY6pjxC6kfuD847ba_EF_GYp9IVIogroTU Sep 06 01:18:27.318953 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Id: None Sep 06 01:18:27.318953 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Name: None Sep 06 01:18:27.318953 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Identity-Status: Confirmed Sep 06 01:18:27.318953 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Is-Admin-Project: True Sep 06 01:18:27.318953 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Id: default Sep 06 01:18:27.318953 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Name: Default Sep 06 01:18:27.318953 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Id: 4c485dab58fc4232844ddf88a3643f00 Sep 06 01:18:27.318953 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Name: tempest-VolumesNegativeTest-1301784528 Sep 06 01:18:27.318953 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Role: reader,member Sep 06 01:18:27.318953 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Roles: reader,member Sep 06 01:18:27.320672 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4c485dab58fc4232844ddf88a3643f00"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4c485dab58fc4232844ddf88a3643f00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4c485dab58fc4232844ddf88a3643f00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4c485dab58fc4232844ddf88a3643f00"}]}] Sep 06 01:18:27.320672 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant: tempest-VolumesNegativeTest-1301784528 Sep 06 01:18:27.320672 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Id: 4c485dab58fc4232844ddf88a3643f00 Sep 06 01:18:27.320672 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Name: tempest-VolumesNegativeTest-1301784528 Sep 06 01:18:27.320672 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User: tempest-VolumesNegativeTest-1301784528-project Sep 06 01:18:27.320672 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Id: default Sep 06 01:18:27.320672 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Name: Default Sep 06 01:18:27.320672 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Id: a09a955033a04334987567274e2fe344 Sep 06 01:18:27.320672 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Name: tempest-VolumesNegativeTest-1301784528-project Sep 06 01:18:27.320672 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: method: Sep 06 01:18:27.320672 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: exception: Volume 3cd8b7f4-615c-4b0a-ba88-161971a00104 could not be found. Sep 06 01:18:27.320672 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: action_args: {'id': '3cd8b7f4-615c-4b0a-ba88-161971a00104'} Sep 06 01:18:27.320672 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:18:27.321573 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:27.321573 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 01:18:27.321573 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 01:18:27.321573 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 01:18:27.321573 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 01:18:27.321573 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 01:18:27.321573 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 01:18:27.321573 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 01:18:27.321573 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 01:18:27.321573 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 01:18:27.321573 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 01:18:27.321573 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 01:18:27.321573 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 01:18:27.321573 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 01:18:27.321573 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 01:18:27.321573 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3cd8b7f4-615c-4b0a-ba88-161971a00104 could not be found. (HTTP 404) (Request-ID: req-4d8c664a-3648-4a4a-881a-6d3d25f9e878) Sep 06 01:18:27.321573 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:27.321573 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:27.321573 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:27.323206 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:27.323206 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 06 01:18:27.323206 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 06 01:18:27.323206 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 01:18:27.323206 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 01:18:27.323206 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 01:18:27.323206 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 01:18:27.323206 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 01:18:27.323206 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 01:18:27.323206 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 01:18:27.323206 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 01:18:27.323206 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 01:18:27.323206 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 01:18:27.323206 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 01:18:27.323206 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 01:18:27.323206 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 01:18:27.323206 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 01:18:27.323206 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 01:18:27.323206 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 01:18:27.324661 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 01:18:27.324661 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 01:18:27.324661 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 01:18:27.324661 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 01:18:27.324661 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3cd8b7f4-615c-4b0a-ba88-161971a00104 could not be found. Sep 06 01:18:27.324661 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:27.324661 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:27.324661 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:27.324661 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:27.324661 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:27.324661 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:27.324661 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:18:27.324661 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:18:27.324661 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 01:18:27.324661 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 01:18:27.324661 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:18:27.324661 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:18:27.324661 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 06 01:18:27.324661 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:18:27.326014 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3cd8b7f4-615c-4b0a-ba88-161971a00104 could not be found. Sep 06 01:18:27.326014 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:27.326014 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:27.326014 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:27.326014 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:27.326014 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:27.326014 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:27.326014 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:18:27.326014 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:18:27.326014 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3cd8b7f4-615c-4b0a-ba88-161971a00104 could not be found. Sep 06 01:18:27.326014 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:27.326014 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-8b3e8834-46f7-4aa9-9b6b-151fe99c8dcb tempest-VolumesNegativeTest-1301784528 tempest-VolumesNegativeTest-1301784528-project] Returning 404 to user: Volume 3cd8b7f4-615c-4b0a-ba88-161971a00104 could not be found. {{(pid=120580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:18:27.326014 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-8b3e8834-46f7-4aa9-9b6b-151fe99c8dcb tempest-VolumesNegativeTest-1301784528 tempest-VolumesNegativeTest-1301784528-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/3cd8b7f4-615c-4b0a-ba88-161971a00104" status: 404 len: 109 microversion: 2.1 time: 0.034484 Sep 06 01:18:27.326014 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 516/996] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Sep 6 01:18:27 2022] GET /compute/v2.1/os-volumes/3cd8b7f4-615c-4b0a-ba88-161971a00104 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 01:18:29.671210 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-eafcd0b1-15d0-43dc-969c-6dd89f1cc6b9 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:29.674258 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-eafcd0b1-15d0-43dc-969c-6dd89f1cc6b9 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: 1a77e639-92e6-4c82-888f-423ae3a0d290] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:29.680881 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eafcd0b1-15d0-43dc-969c-6dd89f1cc6b9 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:29.681595 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eafcd0b1-15d0-43dc-969c-6dd89f1cc6b9 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:29.682062 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eafcd0b1-15d0-43dc-969c-6dd89f1cc6b9 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:29.682824 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eafcd0b1-15d0-43dc-969c-6dd89f1cc6b9 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:29.683281 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eafcd0b1-15d0-43dc-969c-6dd89f1cc6b9 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:29.683836 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eafcd0b1-15d0-43dc-969c-6dd89f1cc6b9 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:29.716658 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-eafcd0b1-15d0-43dc-969c-6dd89f1cc6b9 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050620 Sep 06 01:18:29.717102 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 481/997] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 6 01:18:29 2022] GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:18:29.732923 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-3fc2c486-323d-40d6-966d-7c067ce3f143 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:29.734293 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-3fc2c486-323d-40d6-966d-7c067ce3f143 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: 1a77e639-92e6-4c82-888f-423ae3a0d290] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:29.745463 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3fc2c486-323d-40d6-966d-7c067ce3f143 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:29.745463 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3fc2c486-323d-40d6-966d-7c067ce3f143 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:29.745463 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3fc2c486-323d-40d6-966d-7c067ce3f143 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:29.745463 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3fc2c486-323d-40d6-966d-7c067ce3f143 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:29.746043 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3fc2c486-323d-40d6-966d-7c067ce3f143 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:29.746043 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3fc2c486-323d-40d6-966d-7c067ce3f143 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:29.782018 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-3fc2c486-323d-40d6-966d-7c067ce3f143 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290/os-volume_attachments/f3cb0fb7-ea31-4604-8090-89c4338397df" status: 200 len: 194 microversion: 2.1 time: 0.055280 Sep 06 01:18:29.782611 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 517/998] 10.222.0.23 () {58 vars in 1413 bytes} [Tue Sep 6 01:18:29 2022] GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290/os-volume_attachments/f3cb0fb7-ea31-4604-8090-89c4338397df => generated 194 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:18:31.196874 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3362a372-93bb-4128-bc61-a5afe4930a7b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fef90af0-7558-42f7-9a0c-85e451ab8e5e"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:18:31.199170 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3362a372-93bb-4128-bc61-a5afe4930a7b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: 1a77e639-92e6-4c82-888f-423ae3a0d290] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:31.205729 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3362a372-93bb-4128-bc61-a5afe4930a7b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:31.206464 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3362a372-93bb-4128-bc61-a5afe4930a7b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:31.207076 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3362a372-93bb-4128-bc61-a5afe4930a7b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:31.207787 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3362a372-93bb-4128-bc61-a5afe4930a7b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:31.208241 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3362a372-93bb-4128-bc61-a5afe4930a7b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:31.208660 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3362a372-93bb-4128-bc61-a5afe4930a7b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:31.492655 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3362a372-93bb-4128-bc61-a5afe4930a7b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "POST /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299943 Sep 06 01:18:31.495794 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 482/999] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Sep 6 01:18:31 2022] POST /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:18:39.061862 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-b5180be9-754d-4d97-bf39-107f028d938b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:39.064281 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-b5180be9-754d-4d97-bf39-107f028d938b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: 1a77e639-92e6-4c82-888f-423ae3a0d290] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:39.071685 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b5180be9-754d-4d97-bf39-107f028d938b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:39.072305 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b5180be9-754d-4d97-bf39-107f028d938b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:39.072846 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b5180be9-754d-4d97-bf39-107f028d938b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:39.073612 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b5180be9-754d-4d97-bf39-107f028d938b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:39.074141 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b5180be9-754d-4d97-bf39-107f028d938b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:39.074640 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b5180be9-754d-4d97-bf39-107f028d938b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:39.108268 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-b5180be9-754d-4d97-bf39-107f028d938b tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051272 Sep 06 01:18:39.109020 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 518/1000] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 6 01:18:39 2022] GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:18:39.258491 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b31ad3b1-2a82-41c6-a334-71adeb00f69d tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:39.259077 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b31ad3b1-2a82-41c6-a334-71adeb00f69d tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: 1a77e639-92e6-4c82-888f-423ae3a0d290] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:39.266861 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b31ad3b1-2a82-41c6-a334-71adeb00f69d tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:39.267584 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b31ad3b1-2a82-41c6-a334-71adeb00f69d tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:39.268085 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b31ad3b1-2a82-41c6-a334-71adeb00f69d tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:39.268773 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b31ad3b1-2a82-41c6-a334-71adeb00f69d tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:39.269358 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b31ad3b1-2a82-41c6-a334-71adeb00f69d tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:39.269655 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b31ad3b1-2a82-41c6-a334-71adeb00f69d tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:39.300559 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b31ad3b1-2a82-41c6-a334-71adeb00f69d tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290/os-volume_attachments/f3cb0fb7-ea31-4604-8090-89c4338397df" status: 200 len: 194 microversion: 2.1 time: 0.048774 Sep 06 01:18:39.301357 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 483/1001] 10.222.0.23 () {58 vars in 1413 bytes} [Tue Sep 6 01:18:39 2022] GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290/os-volume_attachments/f3cb0fb7-ea31-4604-8090-89c4338397df => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:18:39.311570 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-b60fa11c-3e12-4760-9192-2f30b39ae18d tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:39.312100 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-b60fa11c-3e12-4760-9192-2f30b39ae18d tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: 1a77e639-92e6-4c82-888f-423ae3a0d290] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:39.318536 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b60fa11c-3e12-4760-9192-2f30b39ae18d tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:39.319024 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b60fa11c-3e12-4760-9192-2f30b39ae18d tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:39.319462 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b60fa11c-3e12-4760-9192-2f30b39ae18d tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:39.320180 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b60fa11c-3e12-4760-9192-2f30b39ae18d tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:39.320640 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b60fa11c-3e12-4760-9192-2f30b39ae18d tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:39.321067 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b60fa11c-3e12-4760-9192-2f30b39ae18d tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:39.405664 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.objects.instance [None req-b60fa11c-3e12-4760-9192-2f30b39ae18d tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lazy-loading 'services' on Instance uuid 1a77e639-92e6-4c82-888f-423ae3a0d290 {{(pid=120580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 01:18:39.485684 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-b60fa11c-3e12-4760-9192-2f30b39ae18d tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290/os-volume_attachments/f3cb0fb7-ea31-4604-8090-89c4338397df" status: 202 len: 0 microversion: 2.1 time: 0.177835 Sep 06 01:18:39.486279 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 519/1002] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Sep 6 01:18:39 2022] DELETE /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290/os-volume_attachments/f3cb0fb7-ea31-4604-8090-89c4338397df => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 01:18:40.624546 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6c6db35c-b40b-4ecb-9383-0e3cca0d5b84 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:40.625073 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6c6db35c-b40b-4ecb-9383-0e3cca0d5b84 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: 1a77e639-92e6-4c82-888f-423ae3a0d290] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:40.632272 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c6db35c-b40b-4ecb-9383-0e3cca0d5b84 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:40.632765 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c6db35c-b40b-4ecb-9383-0e3cca0d5b84 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:40.633209 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c6db35c-b40b-4ecb-9383-0e3cca0d5b84 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:40.633917 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c6db35c-b40b-4ecb-9383-0e3cca0d5b84 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:40.634382 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c6db35c-b40b-4ecb-9383-0e3cca0d5b84 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:40.634814 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c6db35c-b40b-4ecb-9383-0e3cca0d5b84 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:40.667888 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6c6db35c-b40b-4ecb-9383-0e3cca0d5b84 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290/os-volume_attachments/fef90af0-7558-42f7-9a0c-85e451ab8e5e" status: 200 len: 194 microversion: 2.1 time: 0.047163 Sep 06 01:18:40.668488 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 484/1003] 10.222.0.23 () {58 vars in 1413 bytes} [Tue Sep 6 01:18:40 2022] GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290/os-volume_attachments/fef90af0-7558-42f7-9a0c-85e451ab8e5e => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:18:40.681865 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-47a8ee27-b574-479c-8b50-a9544bdc9308 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:40.682528 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-47a8ee27-b574-479c-8b50-a9544bdc9308 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: 1a77e639-92e6-4c82-888f-423ae3a0d290] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:40.689236 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-47a8ee27-b574-479c-8b50-a9544bdc9308 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:40.689940 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-47a8ee27-b574-479c-8b50-a9544bdc9308 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:40.691281 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-47a8ee27-b574-479c-8b50-a9544bdc9308 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:40.692109 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-47a8ee27-b574-479c-8b50-a9544bdc9308 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:40.692637 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-47a8ee27-b574-479c-8b50-a9544bdc9308 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:40.693148 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-47a8ee27-b574-479c-8b50-a9544bdc9308 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:40.782964 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.objects.instance [None req-47a8ee27-b574-479c-8b50-a9544bdc9308 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lazy-loading 'services' on Instance uuid 1a77e639-92e6-4c82-888f-423ae3a0d290 {{(pid=120580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 01:18:40.861380 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-47a8ee27-b574-479c-8b50-a9544bdc9308 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290/os-volume_attachments/fef90af0-7558-42f7-9a0c-85e451ab8e5e" status: 202 len: 0 microversion: 2.1 time: 0.184497 Sep 06 01:18:40.862937 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 520/1004] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Sep 6 01:18:40 2022] DELETE /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290/os-volume_attachments/fef90af0-7558-42f7-9a0c-85e451ab8e5e => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 01:18:42.052801 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b7f5a696-d552-4aa2-98ba-c14be86c6945 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:42.056783 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b7f5a696-d552-4aa2-98ba-c14be86c6945 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: 1a77e639-92e6-4c82-888f-423ae3a0d290] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:42.063996 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7f5a696-d552-4aa2-98ba-c14be86c6945 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:42.064486 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7f5a696-d552-4aa2-98ba-c14be86c6945 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:42.064963 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7f5a696-d552-4aa2-98ba-c14be86c6945 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:42.065662 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7f5a696-d552-4aa2-98ba-c14be86c6945 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:42.066282 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7f5a696-d552-4aa2-98ba-c14be86c6945 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:42.066715 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7f5a696-d552-4aa2-98ba-c14be86c6945 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:42.099727 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b7f5a696-d552-4aa2-98ba-c14be86c6945 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050691 Sep 06 01:18:42.100563 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 485/1005] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 6 01:18:42 2022] GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 01:18:42.224365 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-b7a4de91-49c6-40bd-ac5a-51e363aac2a3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:42.226731 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-b7a4de91-49c6-40bd-ac5a-51e363aac2a3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: 1a77e639-92e6-4c82-888f-423ae3a0d290] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:42.233368 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b7a4de91-49c6-40bd-ac5a-51e363aac2a3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:42.233913 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b7a4de91-49c6-40bd-ac5a-51e363aac2a3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:42.234356 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b7a4de91-49c6-40bd-ac5a-51e363aac2a3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:42.235054 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b7a4de91-49c6-40bd-ac5a-51e363aac2a3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:42.235610 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b7a4de91-49c6-40bd-ac5a-51e363aac2a3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:42.236059 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b7a4de91-49c6-40bd-ac5a-51e363aac2a3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:42.265699 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-b7a4de91-49c6-40bd-ac5a-51e363aac2a3 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046974 Sep 06 01:18:42.266341 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 521/1006] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 6 01:18:42 2022] GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 01:18:42.332178 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9d844cae-3915-4198-83af-255a40e17fc1 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:42.332803 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9d844cae-3915-4198-83af-255a40e17fc1 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: 1a77e639-92e6-4c82-888f-423ae3a0d290] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:42.339042 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9d844cae-3915-4198-83af-255a40e17fc1 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:42.339503 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9d844cae-3915-4198-83af-255a40e17fc1 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:42.340159 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9d844cae-3915-4198-83af-255a40e17fc1 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:42.340851 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9d844cae-3915-4198-83af-255a40e17fc1 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:42.341305 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9d844cae-3915-4198-83af-255a40e17fc1 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:42.341737 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9d844cae-3915-4198-83af-255a40e17fc1 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:42.367039 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9d844cae-3915-4198-83af-255a40e17fc1 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: 1a77e639-92e6-4c82-888f-423ae3a0d290] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 01:18:42.445654 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9d844cae-3915-4198-83af-255a40e17fc1 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290" status: 204 len: 0 microversion: 2.1 time: 0.118031 Sep 06 01:18:42.446559 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 486/1007] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 6 01:18:42 2022] DELETE /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 01:18:42.454753 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-ac8523d2-971e-4d5f-a6a7-25111a1a74e5 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:42.456960 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-ac8523d2-971e-4d5f-a6a7-25111a1a74e5 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: 1a77e639-92e6-4c82-888f-423ae3a0d290] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:42.465089 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ac8523d2-971e-4d5f-a6a7-25111a1a74e5 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:42.465582 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ac8523d2-971e-4d5f-a6a7-25111a1a74e5 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:42.466117 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ac8523d2-971e-4d5f-a6a7-25111a1a74e5 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:42.466849 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ac8523d2-971e-4d5f-a6a7-25111a1a74e5 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:42.467301 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ac8523d2-971e-4d5f-a6a7-25111a1a74e5 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:42.468046 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ac8523d2-971e-4d5f-a6a7-25111a1a74e5 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:42.614812 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-ac8523d2-971e-4d5f-a6a7-25111a1a74e5 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:42.620445 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-ac8523d2-971e-4d5f-a6a7-25111a1a74e5 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290" status: 200 len: 1671 microversion: 2.1 time: 0.169735 Sep 06 01:18:42.621005 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 522/1008] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:18:42 2022] GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290 => generated 1671 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:18:43.644720 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-38ed46a8-0cc9-45df-8877-3b91d017d6dd tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:43.645423 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-38ed46a8-0cc9-45df-8877-3b91d017d6dd tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: 1a77e639-92e6-4c82-888f-423ae3a0d290] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:43.651973 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38ed46a8-0cc9-45df-8877-3b91d017d6dd tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:43.652662 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38ed46a8-0cc9-45df-8877-3b91d017d6dd tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:43.653242 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38ed46a8-0cc9-45df-8877-3b91d017d6dd tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:43.654120 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38ed46a8-0cc9-45df-8877-3b91d017d6dd tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:43.654584 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38ed46a8-0cc9-45df-8877-3b91d017d6dd tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:43.655000 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38ed46a8-0cc9-45df-8877-3b91d017d6dd tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:43.786638 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-38ed46a8-0cc9-45df-8877-3b91d017d6dd tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:43.794610 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-38ed46a8-0cc9-45df-8877-3b91d017d6dd tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290" status: 200 len: 1671 microversion: 2.1 time: 0.154638 Sep 06 01:18:43.795164 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 487/1009] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:18:43 2022] GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290 => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:18:44.818029 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-422e0583-75ca-4af5-952d-e1ac4574b7f8 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:44.818643 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-422e0583-75ca-4af5-952d-e1ac4574b7f8 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: 1a77e639-92e6-4c82-888f-423ae3a0d290] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:44.825233 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-422e0583-75ca-4af5-952d-e1ac4574b7f8 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:44.825711 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-422e0583-75ca-4af5-952d-e1ac4574b7f8 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:44.826149 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-422e0583-75ca-4af5-952d-e1ac4574b7f8 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:44.826838 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-422e0583-75ca-4af5-952d-e1ac4574b7f8 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:44.827289 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-422e0583-75ca-4af5-952d-e1ac4574b7f8 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:44.827712 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-422e0583-75ca-4af5-952d-e1ac4574b7f8 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:44.831731 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:18:44.958618 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-422e0583-75ca-4af5-952d-e1ac4574b7f8 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:44.966130 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-422e0583-75ca-4af5-952d-e1ac4574b7f8 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290" status: 200 len: 1671 microversion: 2.1 time: 0.152955 Sep 06 01:18:44.966686 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 523/1010] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:18:44 2022] GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290 => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:18:45.990004 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bdc8aa9b-5fe3-4fa9-8b12-db4a24641ac4 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:45.990618 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bdc8aa9b-5fe3-4fa9-8b12-db4a24641ac4 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: 1a77e639-92e6-4c82-888f-423ae3a0d290] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:45.997115 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bdc8aa9b-5fe3-4fa9-8b12-db4a24641ac4 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:45.997603 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bdc8aa9b-5fe3-4fa9-8b12-db4a24641ac4 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:45.998036 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bdc8aa9b-5fe3-4fa9-8b12-db4a24641ac4 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:45.998753 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bdc8aa9b-5fe3-4fa9-8b12-db4a24641ac4 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:45.999207 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bdc8aa9b-5fe3-4fa9-8b12-db4a24641ac4 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:45.999632 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bdc8aa9b-5fe3-4fa9-8b12-db4a24641ac4 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:46.128368 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-bdc8aa9b-5fe3-4fa9-8b12-db4a24641ac4 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:46.135959 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bdc8aa9b-5fe3-4fa9-8b12-db4a24641ac4 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290" status: 200 len: 1671 microversion: 2.1 time: 0.150341 Sep 06 01:18:46.136521 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 488/1011] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:18:45 2022] GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290 => generated 1671 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:18:47.159698 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-fc34c7ce-469b-4dca-96bb-e4c9c107eb26 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:47.160415 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-fc34c7ce-469b-4dca-96bb-e4c9c107eb26 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: 1a77e639-92e6-4c82-888f-423ae3a0d290] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:47.167504 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fc34c7ce-469b-4dca-96bb-e4c9c107eb26 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:47.168236 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fc34c7ce-469b-4dca-96bb-e4c9c107eb26 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:47.168893 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fc34c7ce-469b-4dca-96bb-e4c9c107eb26 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:47.169599 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fc34c7ce-469b-4dca-96bb-e4c9c107eb26 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:47.170184 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fc34c7ce-469b-4dca-96bb-e4c9c107eb26 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:47.170993 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-fc34c7ce-469b-4dca-96bb-e4c9c107eb26 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:47.219920 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-8ea42f0d-0808-4c6a-ada0-1510481e0259 req-56ba1225-9d68-43d9-a7bc-6c2bd02dc009 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a77e639-92e6-4c82-888f-423ae3a0d290", "name": "network-vif-deleted", "tag": "7e16664d-c221-4c8e-9a39-00aed6e29f44"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:18:47.239271 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8ea42f0d-0808-4c6a-ada0-1510481e0259 req-56ba1225-9d68-43d9-a7bc-6c2bd02dc009 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:47.240680 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8ea42f0d-0808-4c6a-ada0-1510481e0259 req-56ba1225-9d68-43d9-a7bc-6c2bd02dc009 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:47.241314 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8ea42f0d-0808-4c6a-ada0-1510481e0259 req-56ba1225-9d68-43d9-a7bc-6c2bd02dc009 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:47.242342 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-fc34c7ce-469b-4dca-96bb-e4c9c107eb26 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:47.246160 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:18:47.250660 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-fc34c7ce-469b-4dca-96bb-e4c9c107eb26 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290" status: 200 len: 1605 microversion: 2.1 time: 0.095528 Sep 06 01:18:47.251743 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 524/1012] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:18:47 2022] GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290 => generated 1605 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:18:47.265846 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-8ea42f0d-0808-4c6a-ada0-1510481e0259 req-56ba1225-9d68-43d9-a7bc-6c2bd02dc009 service nova] Creating event network-vif-deleted:7e16664d-c221-4c8e-9a39-00aed6e29f44 for instance 1a77e639-92e6-4c82-888f-423ae3a0d290 on hv-cinder-84773 Sep 06 01:18:47.272148 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-8ea42f0d-0808-4c6a-ada0-1510481e0259 req-56ba1225-9d68-43d9-a7bc-6c2bd02dc009 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055937 Sep 06 01:18:47.272960 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 489/1013] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:18:48.274630 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-b0f5320d-798e-472d-9d51-e5e339ea8a53 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:48.275286 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-b0f5320d-798e-472d-9d51-e5e339ea8a53 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: 1a77e639-92e6-4c82-888f-423ae3a0d290] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:48.282047 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b0f5320d-798e-472d-9d51-e5e339ea8a53 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:48.282536 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b0f5320d-798e-472d-9d51-e5e339ea8a53 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:48.283189 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b0f5320d-798e-472d-9d51-e5e339ea8a53 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:48.283941 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b0f5320d-798e-472d-9d51-e5e339ea8a53 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:48.284399 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b0f5320d-798e-472d-9d51-e5e339ea8a53 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:48.284814 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b0f5320d-798e-472d-9d51-e5e339ea8a53 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:48.345522 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-b0f5320d-798e-472d-9d51-e5e339ea8a53 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:48.353254 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-b0f5320d-798e-472d-9d51-e5e339ea8a53 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290" status: 200 len: 1322 microversion: 2.1 time: 0.082696 Sep 06 01:18:48.353812 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 525/1014] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:18:48 2022] GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290 => generated 1322 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:18:49.377862 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dee10b25-ea23-4b1d-bc12-0daba4697ff1 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:49.378626 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-dee10b25-ea23-4b1d-bc12-0daba4697ff1 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: 1a77e639-92e6-4c82-888f-423ae3a0d290] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:49.385141 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dee10b25-ea23-4b1d-bc12-0daba4697ff1 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:49.385623 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dee10b25-ea23-4b1d-bc12-0daba4697ff1 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:49.386056 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dee10b25-ea23-4b1d-bc12-0daba4697ff1 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:49.386742 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dee10b25-ea23-4b1d-bc12-0daba4697ff1 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:49.387194 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dee10b25-ea23-4b1d-bc12-0daba4697ff1 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:49.387615 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dee10b25-ea23-4b1d-bc12-0daba4697ff1 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:49.449181 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-dee10b25-ea23-4b1d-bc12-0daba4697ff1 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:49.457487 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dee10b25-ea23-4b1d-bc12-0daba4697ff1 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290" status: 200 len: 1322 microversion: 2.1 time: 0.085010 Sep 06 01:18:49.458045 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 490/1015] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:18:49 2022] GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290 => generated 1322 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:18:49.847924 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-8b24e261-502d-495b-8a66-ad32afec1db4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:49.850194 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-8b24e261-502d-495b-8a66-ad32afec1db4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:49.856686 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8b24e261-502d-495b-8a66-ad32afec1db4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:49.857174 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8b24e261-502d-495b-8a66-ad32afec1db4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:49.857615 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8b24e261-502d-495b-8a66-ad32afec1db4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:49.858302 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8b24e261-502d-495b-8a66-ad32afec1db4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:49.858757 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8b24e261-502d-495b-8a66-ad32afec1db4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:49.859183 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-8b24e261-502d-495b-8a66-ad32afec1db4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:49.890782 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-8b24e261-502d-495b-8a66-ad32afec1db4 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047002 Sep 06 01:18:49.891349 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 526/1016] 10.222.0.23 () {60 vars in 1343 bytes} [Tue Sep 6 01:18:49 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:18:49.954532 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6643e38c-d946-4d10-ba30-a1c8514a1db1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:49.955025 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6643e38c-d946-4d10-ba30-a1c8514a1db1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:49.960908 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6643e38c-d946-4d10-ba30-a1c8514a1db1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:49.961389 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6643e38c-d946-4d10-ba30-a1c8514a1db1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:49.961828 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6643e38c-d946-4d10-ba30-a1c8514a1db1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:49.962514 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6643e38c-d946-4d10-ba30-a1c8514a1db1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:49.962970 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6643e38c-d946-4d10-ba30-a1c8514a1db1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:49.963393 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6643e38c-d946-4d10-ba30-a1c8514a1db1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:49.989063 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6643e38c-d946-4d10-ba30-a1c8514a1db1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 01:18:50.065280 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6643e38c-d946-4d10-ba30-a1c8514a1db1 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "DELETE /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 204 len: 0 microversion: 2.20 time: 0.114285 Sep 06 01:18:50.066477 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 491/1017] 10.222.0.23 () {60 vars in 1280 bytes} [Tue Sep 6 01:18:49 2022] DELETE /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 01:18:50.074646 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-46405c23-2235-4fee-a826-fcb62d9afc26 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:50.075625 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-46405c23-2235-4fee-a826-fcb62d9afc26 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:50.077497 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:18:50.083894 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-46405c23-2235-4fee-a826-fcb62d9afc26 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:50.084849 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-46405c23-2235-4fee-a826-fcb62d9afc26 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:50.085741 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-46405c23-2235-4fee-a826-fcb62d9afc26 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:50.086365 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-46405c23-2235-4fee-a826-fcb62d9afc26 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:50.087117 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-46405c23-2235-4fee-a826-fcb62d9afc26 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:50.087712 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-46405c23-2235-4fee-a826-fcb62d9afc26 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:50.217785 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-46405c23-2235-4fee-a826-fcb62d9afc26 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:50.226249 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-46405c23-2235-4fee-a826-fcb62d9afc26 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:50.227693 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-46405c23-2235-4fee-a826-fcb62d9afc26 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:50.228878 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-46405c23-2235-4fee-a826-fcb62d9afc26 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1724 microversion: 2.20 time: 0.158200 Sep 06 01:18:50.229434 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 527/1018] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:18:50 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:18:50.479497 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9ef245f7-22cd-46b5-a402-1398697d4076 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:50.480227 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9ef245f7-22cd-46b5-a402-1398697d4076 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: 1a77e639-92e6-4c82-888f-423ae3a0d290] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:50.486593 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9ef245f7-22cd-46b5-a402-1398697d4076 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:50.487074 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9ef245f7-22cd-46b5-a402-1398697d4076 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:50.487513 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9ef245f7-22cd-46b5-a402-1398697d4076 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:50.488232 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9ef245f7-22cd-46b5-a402-1398697d4076 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:50.488685 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9ef245f7-22cd-46b5-a402-1398697d4076 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:50.489109 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9ef245f7-22cd-46b5-a402-1398697d4076 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:50.519176 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9ef245f7-22cd-46b5-a402-1398697d4076 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:50.519650 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9ef245f7-22cd-46b5-a402-1398697d4076 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:50.520109 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9ef245f7-22cd-46b5-a402-1398697d4076 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:50.520546 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-9ef245f7-22cd-46b5-a402-1398697d4076 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lazy-loading 'fault' on Instance uuid 1a77e639-92e6-4c82-888f-423ae3a0d290 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 01:18:50.563515 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-9ef245f7-22cd-46b5-a402-1398697d4076 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17a4e664b2c4ac9a9fea65287faad95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cfec738cab491ba413e062b5a00813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:50.571067 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9ef245f7-22cd-46b5-a402-1398697d4076 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290" status: 200 len: 1327 microversion: 2.1 time: 0.095774 Sep 06 01:18:50.571622 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 492/1019] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:18:50 2022] GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290 => generated 1327 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:18:51.255191 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-0a20c920-356f-4a07-8b84-60c84b4e9af5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:51.255821 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-0a20c920-356f-4a07-8b84-60c84b4e9af5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:51.262123 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0a20c920-356f-4a07-8b84-60c84b4e9af5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:51.262597 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0a20c920-356f-4a07-8b84-60c84b4e9af5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:51.263026 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0a20c920-356f-4a07-8b84-60c84b4e9af5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:51.263737 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0a20c920-356f-4a07-8b84-60c84b4e9af5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:51.264205 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0a20c920-356f-4a07-8b84-60c84b4e9af5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:51.264623 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0a20c920-356f-4a07-8b84-60c84b4e9af5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:51.392103 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-0a20c920-356f-4a07-8b84-60c84b4e9af5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:51.400055 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-0a20c920-356f-4a07-8b84-60c84b4e9af5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:51.401486 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-0a20c920-356f-4a07-8b84-60c84b4e9af5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:51.402629 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-0a20c920-356f-4a07-8b84-60c84b4e9af5 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1724 microversion: 2.20 time: 0.151925 Sep 06 01:18:51.403180 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 528/1020] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:18:51 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:18:51.594547 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1da936fe-113c-4d90-889b-0be746f69b76 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:51.595230 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1da936fe-113c-4d90-889b-0be746f69b76 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: 1a77e639-92e6-4c82-888f-423ae3a0d290] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:51.602531 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1da936fe-113c-4d90-889b-0be746f69b76 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:51.603014 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1da936fe-113c-4d90-889b-0be746f69b76 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:51.603452 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1da936fe-113c-4d90-889b-0be746f69b76 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:51.604174 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1da936fe-113c-4d90-889b-0be746f69b76 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:51.604627 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1da936fe-113c-4d90-889b-0be746f69b76 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:51.605062 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1da936fe-113c-4d90-889b-0be746f69b76 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:51.619098 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-1da936fe-113c-4d90-889b-0be746f69b76 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] HTTP exception thrown: Instance 1a77e639-92e6-4c82-888f-423ae3a0d290 could not be found. Sep 06 01:18:51.620765 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1da936fe-113c-4d90-889b-0be746f69b76 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Request method failure captured: Sep 06 01:18:51.620765 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290 HTTP/1.1 Sep 06 01:18:51.620765 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept: application/json Sep 06 01:18:51.620765 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept-Encoding: identity Sep 06 01:18:51.620765 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Connection: close Sep 06 01:18:51.620765 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Length: 0 Sep 06 01:18:51.620765 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Type: application/json Sep 06 01:18:51.620765 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Host: 10.222.0.23 Sep 06 01:18:51.620765 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Openstack-System-Scope: None Sep 06 01:18:51.620765 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Sep 06 01:18:51.620765 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjFp6ScmWDY6l7TPFx_-ileNNzy-0TIvlQgL1o_EzXzNOdniRzn-Q3l_uLSFf7uv6gmkkLfBpFrrQPrRiOoZd0XJLC1l439UYTTcF-PMxKM89jtzOq5RKgPdvEksMIjlekHUzKLmQj2uw0iewtZ-i1W_EHF7V8nHnuSbe2RR5Koil9CFE Sep 06 01:18:51.620765 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Id: None Sep 06 01:18:51.620765 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Name: None Sep 06 01:18:51.620765 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Identity-Status: Confirmed Sep 06 01:18:51.620765 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Is-Admin-Project: True Sep 06 01:18:51.620765 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Id: default Sep 06 01:18:51.620765 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Name: Default Sep 06 01:18:51.620765 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Id: 80cfec738cab491ba413e062b5a00813 Sep 06 01:18:51.620765 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Name: tempest-AttachVolumeTestJSON-1010990594 Sep 06 01:18:51.620765 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Role: reader,member Sep 06 01:18:51.620765 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Roles: reader,member Sep 06 01:18:51.622377 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/80cfec738cab491ba413e062b5a00813"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/80cfec738cab491ba413e062b5a00813"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_80cfec738cab491ba413e062b5a00813"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/80cfec738cab491ba413e062b5a00813"}]}] Sep 06 01:18:51.622377 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant: tempest-AttachVolumeTestJSON-1010990594 Sep 06 01:18:51.622377 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Id: 80cfec738cab491ba413e062b5a00813 Sep 06 01:18:51.622377 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1010990594 Sep 06 01:18:51.622377 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User: tempest-AttachVolumeTestJSON-1010990594-project Sep 06 01:18:51.622377 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Id: default Sep 06 01:18:51.622377 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Name: Default Sep 06 01:18:51.622377 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Id: e17a4e664b2c4ac9a9fea65287faad95 Sep 06 01:18:51.622377 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Name: tempest-AttachVolumeTestJSON-1010990594-project Sep 06 01:18:51.622377 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: method: > Sep 06 01:18:51.622377 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: exception: Instance 1a77e639-92e6-4c82-888f-423ae3a0d290 could not be found. Sep 06 01:18:51.622377 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: action_args: {'id': '1a77e639-92e6-4c82-888f-423ae3a0d290'} Sep 06 01:18:51.623550 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:18:51.623550 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:51.623550 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 01:18:51.623550 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 01:18:51.623550 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 01:18:51.623550 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 01:18:51.623550 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 01:18:51.623550 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 01:18:51.623550 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 01:18:51.623550 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 01:18:51.623550 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a77e639-92e6-4c82-888f-423ae3a0d290 could not be found. Sep 06 01:18:51.623550 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:51.623550 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:51.623550 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:51.623550 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:51.623550 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:51.623550 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:51.623550 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:18:51.623550 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:18:51.623550 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:18:51.624822 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:18:51.624822 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 01:18:51.624822 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 01:18:51.624822 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 01:18:51.624822 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 01:18:51.624822 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 01:18:51.624822 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:18:51.624822 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a77e639-92e6-4c82-888f-423ae3a0d290 could not be found. Sep 06 01:18:51.624822 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:51.624822 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:51.624822 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:51.624822 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:51.624822 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:51.624822 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:51.624822 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:18:51.624822 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:18:51.624822 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a77e639-92e6-4c82-888f-423ae3a0d290 could not be found. Sep 06 01:18:51.624822 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:51.626597 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1da936fe-113c-4d90-889b-0be746f69b76 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Returning 404 to user: Instance 1a77e639-92e6-4c82-888f-423ae3a0d290 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:18:51.626597 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1da936fe-113c-4d90-889b-0be746f69b76 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290" status: 404 len: 111 microversion: 2.1 time: 0.031529 Sep 06 01:18:51.626597 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 493/1021] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:18:51 2022] GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 01:18:51.631298 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-a8190ecf-4f5d-4a76-b51c-75866f7b2ce4 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '.version_select at 0x7fb06dff5ee0>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:51.650482 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-a8190ecf-4f5d-4a76-b51c-75866f7b2ce4 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1079460770" status: 202 len: 0 microversion: 2.1 time: 0.022866 Sep 06 01:18:51.651073 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 529/1022] 10.222.0.23 () {58 vars in 1221 bytes} [Tue Sep 6 01:18:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1079460770 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 01:18:52.428901 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-71137c1a-d2cc-4112-87d4-92b94035a8cd tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:52.429540 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-71137c1a-d2cc-4112-87d4-92b94035a8cd tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:52.441220 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-71137c1a-d2cc-4112-87d4-92b94035a8cd tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:52.442597 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-71137c1a-d2cc-4112-87d4-92b94035a8cd tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:52.443529 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-71137c1a-d2cc-4112-87d4-92b94035a8cd tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:52.444897 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-71137c1a-d2cc-4112-87d4-92b94035a8cd tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:52.445571 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-71137c1a-d2cc-4112-87d4-92b94035a8cd tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:52.446516 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-71137c1a-d2cc-4112-87d4-92b94035a8cd tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:52.516912 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-71137c1a-d2cc-4112-87d4-92b94035a8cd tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:52.528237 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-71137c1a-d2cc-4112-87d4-92b94035a8cd tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:52.530692 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-71137c1a-d2cc-4112-87d4-92b94035a8cd tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:52.532010 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-71137c1a-d2cc-4112-87d4-92b94035a8cd tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1656 microversion: 2.20 time: 0.106978 Sep 06 01:18:52.532719 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 494/1023] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:18:52 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1656 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:18:52.630502 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-83aadeb5-4cba-43db-9adf-0266256ab408 req-b4e63f9a-68f2-46e2-9017-9df593e64adb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "366390df-669b-48b1-b741-56d5fdd64441", "name": "network-vif-deleted", "tag": "703a4acd-427c-4fd4-bf73-f445a5bcac26"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:18:52.646657 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-83aadeb5-4cba-43db-9adf-0266256ab408 req-b4e63f9a-68f2-46e2-9017-9df593e64adb service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:52.647468 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-83aadeb5-4cba-43db-9adf-0266256ab408 req-b4e63f9a-68f2-46e2-9017-9df593e64adb service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:52.648224 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-83aadeb5-4cba-43db-9adf-0266256ab408 req-b4e63f9a-68f2-46e2-9017-9df593e64adb service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:52.663070 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.compute.server_external_events [req-83aadeb5-4cba-43db-9adf-0266256ab408 req-b4e63f9a-68f2-46e2-9017-9df593e64adb service nova] Creating event network-vif-deleted:703a4acd-427c-4fd4-bf73-f445a5bcac26 for instance 366390df-669b-48b1-b741-56d5fdd64441 on hv-cinder-84773 Sep 06 01:18:52.670140 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [req-83aadeb5-4cba-43db-9adf-0266256ab408 req-b4e63f9a-68f2-46e2-9017-9df593e64adb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045139 Sep 06 01:18:52.670731 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 530/1024] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:18:53.558825 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bff0d64e-9157-4d0a-8de9-bbf2c3215e53 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:53.559972 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bff0d64e-9157-4d0a-8de9-bbf2c3215e53 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:53.562365 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:18:53.567686 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bff0d64e-9157-4d0a-8de9-bbf2c3215e53 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:53.568194 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bff0d64e-9157-4d0a-8de9-bbf2c3215e53 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:53.568629 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bff0d64e-9157-4d0a-8de9-bbf2c3215e53 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:53.569326 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bff0d64e-9157-4d0a-8de9-bbf2c3215e53 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:53.569780 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bff0d64e-9157-4d0a-8de9-bbf2c3215e53 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:53.570205 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bff0d64e-9157-4d0a-8de9-bbf2c3215e53 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:53.607226 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bff0d64e-9157-4d0a-8de9-bbf2c3215e53 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:53.607708 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bff0d64e-9157-4d0a-8de9-bbf2c3215e53 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:53.608173 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bff0d64e-9157-4d0a-8de9-bbf2c3215e53 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:53.608601 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-bff0d64e-9157-4d0a-8de9-bbf2c3215e53 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lazy-loading 'fault' on Instance uuid 366390df-669b-48b1-b741-56d5fdd64441 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 01:18:53.648994 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-bff0d64e-9157-4d0a-8de9-bbf2c3215e53 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:53.657755 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-bff0d64e-9157-4d0a-8de9-bbf2c3215e53 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:53.659679 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-bff0d64e-9157-4d0a-8de9-bbf2c3215e53 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:53.660857 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bff0d64e-9157-4d0a-8de9-bbf2c3215e53 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1371 microversion: 2.20 time: 0.105957 Sep 06 01:18:53.661418 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 495/1025] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:18:53 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1371 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 01:18:54.686277 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-00c6d7aa-34b5-42c3-9c79-ee5266a709ea tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:54.686968 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-00c6d7aa-34b5-42c3-9c79-ee5266a709ea tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:54.693705 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-00c6d7aa-34b5-42c3-9c79-ee5266a709ea tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:54.694182 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-00c6d7aa-34b5-42c3-9c79-ee5266a709ea tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:54.694612 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-00c6d7aa-34b5-42c3-9c79-ee5266a709ea tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:54.695320 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-00c6d7aa-34b5-42c3-9c79-ee5266a709ea tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:54.695779 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-00c6d7aa-34b5-42c3-9c79-ee5266a709ea tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:54.696205 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-00c6d7aa-34b5-42c3-9c79-ee5266a709ea tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:54.726802 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-00c6d7aa-34b5-42c3-9c79-ee5266a709ea tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:54.727280 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-00c6d7aa-34b5-42c3-9c79-ee5266a709ea tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:54.727707 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-00c6d7aa-34b5-42c3-9c79-ee5266a709ea tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:54.728165 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.objects.instance [None req-00c6d7aa-34b5-42c3-9c79-ee5266a709ea tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lazy-loading 'fault' on Instance uuid 366390df-669b-48b1-b741-56d5fdd64441 {{(pid=120580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 01:18:54.772105 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-00c6d7aa-34b5-42c3-9c79-ee5266a709ea tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:54.780020 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-00c6d7aa-34b5-42c3-9c79-ee5266a709ea tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:54.781451 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-00c6d7aa-34b5-42c3-9c79-ee5266a709ea tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc5c46544a447159b7fd3d225cd9697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c096a50088a4b8dbd00458b324f301e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:18:54.782588 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-00c6d7aa-34b5-42c3-9c79-ee5266a709ea tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 200 len: 1371 microversion: 2.20 time: 0.100572 Sep 06 01:18:54.783787 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 531/1026] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:18:54 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 1371 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 01:18:55.676641 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-587535b2-aa3d-4573-8d1d-1368cfd01255 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:55.677203 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-587535b2-aa3d-4573-8d1d-1368cfd01255 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: 1a77e639-92e6-4c82-888f-423ae3a0d290] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:55.683807 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-587535b2-aa3d-4573-8d1d-1368cfd01255 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:55.684517 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-587535b2-aa3d-4573-8d1d-1368cfd01255 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:55.685040 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-587535b2-aa3d-4573-8d1d-1368cfd01255 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:55.685985 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-587535b2-aa3d-4573-8d1d-1368cfd01255 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:55.686527 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-587535b2-aa3d-4573-8d1d-1368cfd01255 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:55.687141 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-587535b2-aa3d-4573-8d1d-1368cfd01255 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:55.709628 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-587535b2-aa3d-4573-8d1d-1368cfd01255 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] HTTP exception thrown: Instance 1a77e639-92e6-4c82-888f-423ae3a0d290 could not be found. Sep 06 01:18:55.711287 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-587535b2-aa3d-4573-8d1d-1368cfd01255 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Request method failure captured: Sep 06 01:18:55.711287 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290 HTTP/1.1 Sep 06 01:18:55.711287 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept: application/json Sep 06 01:18:55.711287 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept-Encoding: identity Sep 06 01:18:55.711287 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Connection: close Sep 06 01:18:55.711287 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Length: 0 Sep 06 01:18:55.711287 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Type: application/json Sep 06 01:18:55.711287 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Host: 10.222.0.23 Sep 06 01:18:55.711287 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Openstack-System-Scope: None Sep 06 01:18:55.711287 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Sep 06 01:18:55.711287 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjFp6ScmWDY6l7TPFx_-ileNNzy-0TIvlQgL1o_EzXzNOdniRzn-Q3l_uLSFf7uv6gmkkLfBpFrrQPrRiOoZd0XJLC1l439UYTTcF-PMxKM89jtzOq5RKgPdvEksMIjlekHUzKLmQj2uw0iewtZ-i1W_EHF7V8nHnuSbe2RR5Koil9CFE Sep 06 01:18:55.711287 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Id: None Sep 06 01:18:55.711287 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Name: None Sep 06 01:18:55.711287 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Identity-Status: Confirmed Sep 06 01:18:55.711287 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Is-Admin-Project: True Sep 06 01:18:55.711287 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Id: default Sep 06 01:18:55.711287 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Name: Default Sep 06 01:18:55.711287 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Id: 80cfec738cab491ba413e062b5a00813 Sep 06 01:18:55.711287 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Name: tempest-AttachVolumeTestJSON-1010990594 Sep 06 01:18:55.711287 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Role: reader,member Sep 06 01:18:55.711287 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Roles: reader,member Sep 06 01:18:55.712893 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/80cfec738cab491ba413e062b5a00813"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/80cfec738cab491ba413e062b5a00813"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_80cfec738cab491ba413e062b5a00813"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/80cfec738cab491ba413e062b5a00813"}]}] Sep 06 01:18:55.712893 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant: tempest-AttachVolumeTestJSON-1010990594 Sep 06 01:18:55.712893 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Id: 80cfec738cab491ba413e062b5a00813 Sep 06 01:18:55.712893 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1010990594 Sep 06 01:18:55.712893 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User: tempest-AttachVolumeTestJSON-1010990594-project Sep 06 01:18:55.712893 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Id: default Sep 06 01:18:55.712893 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Name: Default Sep 06 01:18:55.712893 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Id: e17a4e664b2c4ac9a9fea65287faad95 Sep 06 01:18:55.712893 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Name: tempest-AttachVolumeTestJSON-1010990594-project Sep 06 01:18:55.712893 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: method: > Sep 06 01:18:55.712893 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: exception: Instance 1a77e639-92e6-4c82-888f-423ae3a0d290 could not be found. Sep 06 01:18:55.712893 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: action_args: {'id': '1a77e639-92e6-4c82-888f-423ae3a0d290'} Sep 06 01:18:55.713659 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:18:55.713659 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:55.713659 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 01:18:55.713659 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 01:18:55.713659 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 01:18:55.713659 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 01:18:55.713659 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 01:18:55.713659 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 01:18:55.713659 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 01:18:55.713659 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 01:18:55.713659 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a77e639-92e6-4c82-888f-423ae3a0d290 could not be found. Sep 06 01:18:55.713659 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:55.713659 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:55.713659 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:55.713659 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:55.713659 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:55.713659 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:55.713659 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:18:55.713659 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:18:55.713659 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:18:55.714881 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:18:55.714881 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 01:18:55.714881 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 01:18:55.714881 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 01:18:55.714881 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 01:18:55.714881 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 01:18:55.714881 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 01:18:55.714881 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 01:18:55.714881 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:18:55.714881 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a77e639-92e6-4c82-888f-423ae3a0d290 could not be found. Sep 06 01:18:55.714881 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:55.714881 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:55.714881 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:55.714881 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:55.714881 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:55.714881 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:55.714881 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:18:55.714881 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:18:55.714881 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a77e639-92e6-4c82-888f-423ae3a0d290 could not be found. Sep 06 01:18:55.714881 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:55.716135 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-587535b2-aa3d-4573-8d1d-1368cfd01255 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Returning 404 to user: Instance 1a77e639-92e6-4c82-888f-423ae3a0d290 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:18:55.716135 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-587535b2-aa3d-4573-8d1d-1368cfd01255 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290" status: 404 len: 111 microversion: 2.1 time: 0.044731 Sep 06 01:18:55.716135 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 496/1027] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 6 01:18:55 2022] DELETE /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 01:18:55.722928 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-3c4e72d7-1339-4192-a6a1-196446c6158e tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:55.723690 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-3c4e72d7-1339-4192-a6a1-196446c6158e tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: 1a77e639-92e6-4c82-888f-423ae3a0d290] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:55.730332 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3c4e72d7-1339-4192-a6a1-196446c6158e tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:55.730821 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3c4e72d7-1339-4192-a6a1-196446c6158e tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:55.731255 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3c4e72d7-1339-4192-a6a1-196446c6158e tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:55.731985 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3c4e72d7-1339-4192-a6a1-196446c6158e tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:55.732442 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3c4e72d7-1339-4192-a6a1-196446c6158e tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:55.732868 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3c4e72d7-1339-4192-a6a1-196446c6158e tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:55.746951 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.wsgi [None req-3c4e72d7-1339-4192-a6a1-196446c6158e tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] HTTP exception thrown: Instance 1a77e639-92e6-4c82-888f-423ae3a0d290 could not be found. Sep 06 01:18:55.748646 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-3c4e72d7-1339-4192-a6a1-196446c6158e tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Request method failure captured: Sep 06 01:18:55.748646 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: request: GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290 HTTP/1.1 Sep 06 01:18:55.748646 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept: application/json Sep 06 01:18:55.748646 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept-Encoding: identity Sep 06 01:18:55.748646 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Connection: close Sep 06 01:18:55.748646 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Length: 0 Sep 06 01:18:55.748646 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Type: application/json Sep 06 01:18:55.748646 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Host: 10.222.0.23 Sep 06 01:18:55.748646 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Openstack-System-Scope: None Sep 06 01:18:55.748646 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: User-Agent: python-urllib3/1.26.12 Sep 06 01:18:55.748646 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Auth-Token: gAAAAABjFp6ScmWDY6l7TPFx_-ileNNzy-0TIvlQgL1o_EzXzNOdniRzn-Q3l_uLSFf7uv6gmkkLfBpFrrQPrRiOoZd0XJLC1l439UYTTcF-PMxKM89jtzOq5RKgPdvEksMIjlekHUzKLmQj2uw0iewtZ-i1W_EHF7V8nHnuSbe2RR5Koil9CFE Sep 06 01:18:55.748646 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Id: None Sep 06 01:18:55.748646 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Name: None Sep 06 01:18:55.748646 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Identity-Status: Confirmed Sep 06 01:18:55.748646 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Is-Admin-Project: True Sep 06 01:18:55.748646 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Id: default Sep 06 01:18:55.748646 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Name: Default Sep 06 01:18:55.748646 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Id: 80cfec738cab491ba413e062b5a00813 Sep 06 01:18:55.748646 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Name: tempest-AttachVolumeTestJSON-1010990594 Sep 06 01:18:55.748646 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Role: reader,member Sep 06 01:18:55.748646 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Roles: reader,member Sep 06 01:18:55.750358 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/80cfec738cab491ba413e062b5a00813"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/80cfec738cab491ba413e062b5a00813"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_80cfec738cab491ba413e062b5a00813"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/80cfec738cab491ba413e062b5a00813"}]}] Sep 06 01:18:55.750358 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant: tempest-AttachVolumeTestJSON-1010990594 Sep 06 01:18:55.750358 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Id: 80cfec738cab491ba413e062b5a00813 Sep 06 01:18:55.750358 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1010990594 Sep 06 01:18:55.750358 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User: tempest-AttachVolumeTestJSON-1010990594-project Sep 06 01:18:55.750358 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Id: default Sep 06 01:18:55.750358 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Name: Default Sep 06 01:18:55.750358 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Id: e17a4e664b2c4ac9a9fea65287faad95 Sep 06 01:18:55.750358 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Name: tempest-AttachVolumeTestJSON-1010990594-project Sep 06 01:18:55.750358 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: method: > Sep 06 01:18:55.750358 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: exception: Instance 1a77e639-92e6-4c82-888f-423ae3a0d290 could not be found. Sep 06 01:18:55.750358 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: action_args: {'id': '1a77e639-92e6-4c82-888f-423ae3a0d290'} Sep 06 01:18:55.751241 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:18:55.751241 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:55.751241 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 01:18:55.751241 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 01:18:55.751241 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 01:18:55.751241 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 01:18:55.751241 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 01:18:55.751241 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 01:18:55.751241 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 01:18:55.751241 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 01:18:55.751241 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a77e639-92e6-4c82-888f-423ae3a0d290 could not be found. Sep 06 01:18:55.751241 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:55.751241 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:55.751241 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:55.751241 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:55.751241 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:55.751241 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:55.751241 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:18:55.751241 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:18:55.751241 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:18:55.752738 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:18:55.752738 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 01:18:55.752738 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 01:18:55.752738 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 01:18:55.752738 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 01:18:55.752738 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 01:18:55.752738 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:18:55.752738 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a77e639-92e6-4c82-888f-423ae3a0d290 could not be found. Sep 06 01:18:55.752738 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:55.752738 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:55.752738 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:55.752738 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:55.752738 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:55.752738 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:55.752738 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:18:55.752738 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:18:55.752738 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a77e639-92e6-4c82-888f-423ae3a0d290 could not be found. Sep 06 01:18:55.752738 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:55.754995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-3c4e72d7-1339-4192-a6a1-196446c6158e tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Returning 404 to user: Instance 1a77e639-92e6-4c82-888f-423ae3a0d290 could not be found. {{(pid=120580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:18:55.754995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-3c4e72d7-1339-4192-a6a1-196446c6158e tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290" status: 404 len: 111 microversion: 2.1 time: 0.031583 Sep 06 01:18:55.754995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 532/1028] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:18:55 2022] GET /compute/v2.1/servers/1a77e639-92e6-4c82-888f-423ae3a0d290 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 01:18:55.810717 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-28374b70-f0b8-4586-94d0-88fe81863be9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:55.811358 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-28374b70-f0b8-4586-94d0-88fe81863be9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:55.819657 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28374b70-f0b8-4586-94d0-88fe81863be9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:55.820250 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28374b70-f0b8-4586-94d0-88fe81863be9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:55.821292 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28374b70-f0b8-4586-94d0-88fe81863be9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:55.822102 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28374b70-f0b8-4586-94d0-88fe81863be9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:55.822544 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28374b70-f0b8-4586-94d0-88fe81863be9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:55.823707 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28374b70-f0b8-4586-94d0-88fe81863be9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:55.838962 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-28374b70-f0b8-4586-94d0-88fe81863be9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] HTTP exception thrown: Instance 366390df-669b-48b1-b741-56d5fdd64441 could not be found. Sep 06 01:18:55.842203 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-28374b70-f0b8-4586-94d0-88fe81863be9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Request method failure captured: Sep 06 01:18:55.842203 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 HTTP/1.1 Sep 06 01:18:55.842203 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept: application/json Sep 06 01:18:55.842203 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept-Encoding: identity Sep 06 01:18:55.842203 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Connection: close Sep 06 01:18:55.842203 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Length: 0 Sep 06 01:18:55.842203 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Type: application/json Sep 06 01:18:55.842203 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Host: 10.222.0.23 Sep 06 01:18:55.842203 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Openstack-System-Scope: None Sep 06 01:18:55.842203 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Sep 06 01:18:55.842203 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjFp5Jd8tx02fVidBaBnu-tf9SqWjO3jnfzKjDhWmOsqgzVcujsHvhG9DLM-9PrGpJG5qdT7IdxHca8UUwPoYffUs9KdEuslWnHY3r_drNtbTZucfHaK6FuPy4dVD0Cvi2Id4jiWbo0XFkjIVQdjNM3FOOqntUj2-Cl0QwEXuE8Co1F1o Sep 06 01:18:55.842203 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Id: None Sep 06 01:18:55.842203 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Name: None Sep 06 01:18:55.842203 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Identity-Status: Confirmed Sep 06 01:18:55.842203 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Is-Admin-Project: True Sep 06 01:18:55.842203 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 01:18:55.842203 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Id: default Sep 06 01:18:55.842203 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Name: Default Sep 06 01:18:55.842203 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Id: 1c096a50088a4b8dbd00458b324f301e Sep 06 01:18:55.842203 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2103393715 Sep 06 01:18:55.842203 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Role: reader,member Sep 06 01:18:55.842203 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Roles: reader,member Sep 06 01:18:55.843635 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c096a50088a4b8dbd00458b324f301e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1c096a50088a4b8dbd00458b324f301e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1c096a50088a4b8dbd00458b324f301e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c096a50088a4b8dbd00458b324f301e"}]}] Sep 06 01:18:55.843635 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2103393715 Sep 06 01:18:55.843635 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Id: 1c096a50088a4b8dbd00458b324f301e Sep 06 01:18:55.843635 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2103393715 Sep 06 01:18:55.843635 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User: tempest-AttachVolumeShelveTestJSON-2103393715-project Sep 06 01:18:55.843635 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Id: default Sep 06 01:18:55.843635 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Name: Default Sep 06 01:18:55.843635 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Id: 2dc5c46544a447159b7fd3d225cd9697 Sep 06 01:18:55.843635 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2103393715-project Sep 06 01:18:55.843635 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: method: > Sep 06 01:18:55.843635 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: exception: Instance 366390df-669b-48b1-b741-56d5fdd64441 could not be found. Sep 06 01:18:55.843635 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: action_args: {'id': '366390df-669b-48b1-b741-56d5fdd64441'} Sep 06 01:18:55.844446 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:18:55.844446 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:55.844446 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 01:18:55.844446 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 01:18:55.844446 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 01:18:55.844446 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 01:18:55.844446 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 01:18:55.844446 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 01:18:55.844446 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 01:18:55.844446 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 01:18:55.844446 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 366390df-669b-48b1-b741-56d5fdd64441 could not be found. Sep 06 01:18:55.844446 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:55.844446 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:55.844446 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:55.844446 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:55.844446 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:55.844446 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:55.844446 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:18:55.844446 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:18:55.844446 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:18:55.845676 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:18:55.845676 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 01:18:55.845676 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 01:18:55.845676 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 01:18:55.845676 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 01:18:55.845676 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 01:18:55.845676 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:18:55.845676 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 366390df-669b-48b1-b741-56d5fdd64441 could not be found. Sep 06 01:18:55.845676 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:55.845676 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:55.845676 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:55.845676 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:55.845676 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:55.845676 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:55.845676 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:18:55.845676 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:18:55.845676 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 366390df-669b-48b1-b741-56d5fdd64441 could not be found. Sep 06 01:18:55.845676 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:55.847723 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-28374b70-f0b8-4586-94d0-88fe81863be9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Returning 404 to user: Instance 366390df-669b-48b1-b741-56d5fdd64441 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:18:55.847723 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-28374b70-f0b8-4586-94d0-88fe81863be9 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 404 len: 111 microversion: 2.20 time: 0.039611 Sep 06 01:18:55.847723 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 497/1029] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:18:55 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 01:18:55.855856 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-0831b050-e045-490d-926b-95b2ce066174 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '.version_select at 0x7fb06e1e91f0>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:55.875813 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-0831b050-e045-490d-926b-95b2ce066174 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-457567430" status: 204 len: 0 microversion: 2.20 time: 0.023841 Sep 06 01:18:55.876389 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 533/1030] 10.222.0.23 () {60 vars in 1259 bytes} [Tue Sep 6 01:18:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-457567430 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 01:18:56.897602 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b4259115-4f83-44bb-968d-6aea9ecaf861 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:56.898107 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b4259115-4f83-44bb-968d-6aea9ecaf861 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:56.904595 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b4259115-4f83-44bb-968d-6aea9ecaf861 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:56.905496 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b4259115-4f83-44bb-968d-6aea9ecaf861 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:56.906040 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b4259115-4f83-44bb-968d-6aea9ecaf861 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:56.906742 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b4259115-4f83-44bb-968d-6aea9ecaf861 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:56.907199 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b4259115-4f83-44bb-968d-6aea9ecaf861 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:56.907629 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b4259115-4f83-44bb-968d-6aea9ecaf861 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:56.924509 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-b4259115-4f83-44bb-968d-6aea9ecaf861 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] HTTP exception thrown: Instance c116182e-e47e-4655-a30d-5f8d52772fba could not be found. Sep 06 01:18:56.926150 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b4259115-4f83-44bb-968d-6aea9ecaf861 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Request method failure captured: Sep 06 01:18:56.926150 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba HTTP/1.1 Sep 06 01:18:56.926150 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept: application/json Sep 06 01:18:56.926150 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept-Encoding: identity Sep 06 01:18:56.926150 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Connection: close Sep 06 01:18:56.926150 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Length: 0 Sep 06 01:18:56.926150 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Type: application/json Sep 06 01:18:56.926150 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Host: 10.222.0.23 Sep 06 01:18:56.926150 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Openstack-System-Scope: None Sep 06 01:18:56.926150 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Sep 06 01:18:56.926150 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjFp6ScmWDY6l7TPFx_-ileNNzy-0TIvlQgL1o_EzXzNOdniRzn-Q3l_uLSFf7uv6gmkkLfBpFrrQPrRiOoZd0XJLC1l439UYTTcF-PMxKM89jtzOq5RKgPdvEksMIjlekHUzKLmQj2uw0iewtZ-i1W_EHF7V8nHnuSbe2RR5Koil9CFE Sep 06 01:18:56.926150 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Id: None Sep 06 01:18:56.926150 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Name: None Sep 06 01:18:56.926150 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Identity-Status: Confirmed Sep 06 01:18:56.926150 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Is-Admin-Project: True Sep 06 01:18:56.926150 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Id: default Sep 06 01:18:56.926150 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Name: Default Sep 06 01:18:56.926150 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Id: 80cfec738cab491ba413e062b5a00813 Sep 06 01:18:56.926150 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Name: tempest-AttachVolumeTestJSON-1010990594 Sep 06 01:18:56.926150 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Role: reader,member Sep 06 01:18:56.926150 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Roles: reader,member Sep 06 01:18:56.927784 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/80cfec738cab491ba413e062b5a00813"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/80cfec738cab491ba413e062b5a00813"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_80cfec738cab491ba413e062b5a00813"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/80cfec738cab491ba413e062b5a00813"}]}] Sep 06 01:18:56.927784 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant: tempest-AttachVolumeTestJSON-1010990594 Sep 06 01:18:56.927784 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Id: 80cfec738cab491ba413e062b5a00813 Sep 06 01:18:56.927784 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1010990594 Sep 06 01:18:56.927784 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User: tempest-AttachVolumeTestJSON-1010990594-project Sep 06 01:18:56.927784 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Id: default Sep 06 01:18:56.927784 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Name: Default Sep 06 01:18:56.927784 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Id: e17a4e664b2c4ac9a9fea65287faad95 Sep 06 01:18:56.927784 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Name: tempest-AttachVolumeTestJSON-1010990594-project Sep 06 01:18:56.927784 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: method: > Sep 06 01:18:56.927784 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: exception: Instance c116182e-e47e-4655-a30d-5f8d52772fba could not be found. Sep 06 01:18:56.927784 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: action_args: {'id': 'c116182e-e47e-4655-a30d-5f8d52772fba'} Sep 06 01:18:56.928702 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:18:56.928702 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:56.928702 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 01:18:56.928702 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 01:18:56.928702 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 01:18:56.928702 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 01:18:56.928702 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 01:18:56.928702 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 01:18:56.928702 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 01:18:56.928702 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 01:18:56.928702 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c116182e-e47e-4655-a30d-5f8d52772fba could not be found. Sep 06 01:18:56.928702 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:56.928702 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:56.928702 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:56.928702 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:56.928702 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:56.928702 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:56.928702 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:18:56.928702 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:18:56.928702 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:18:56.939766 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:18:56.939766 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 01:18:56.939766 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 01:18:56.939766 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 01:18:56.939766 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 01:18:56.939766 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 01:18:56.939766 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 01:18:56.939766 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 01:18:56.939766 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:18:56.939766 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c116182e-e47e-4655-a30d-5f8d52772fba could not be found. Sep 06 01:18:56.939766 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:56.939766 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:56.939766 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:56.939766 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:56.939766 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:56.939766 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:56.939766 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:18:56.939766 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:18:56.939766 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c116182e-e47e-4655-a30d-5f8d52772fba could not be found. Sep 06 01:18:56.939766 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:56.941832 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b4259115-4f83-44bb-968d-6aea9ecaf861 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Returning 404 to user: Instance c116182e-e47e-4655-a30d-5f8d52772fba could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:18:56.941832 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b4259115-4f83-44bb-968d-6aea9ecaf861 tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 404 len: 111 microversion: 2.1 time: 0.034638 Sep 06 01:18:56.941832 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 498/1031] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 6 01:18:56 2022] DELETE /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 01:18:56.942049 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-ec2a1125-d873-4329-992a-650608a4141a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:56.942049 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-ec2a1125-d873-4329-992a-650608a4141a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] [instance: c116182e-e47e-4655-a30d-5f8d52772fba] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:56.946101 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ec2a1125-d873-4329-992a-650608a4141a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:56.946585 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ec2a1125-d873-4329-992a-650608a4141a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:56.947012 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ec2a1125-d873-4329-992a-650608a4141a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:56.947707 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ec2a1125-d873-4329-992a-650608a4141a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:56.948183 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ec2a1125-d873-4329-992a-650608a4141a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:56.948618 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ec2a1125-d873-4329-992a-650608a4141a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:56.966238 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.wsgi [None req-ec2a1125-d873-4329-992a-650608a4141a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] HTTP exception thrown: Instance c116182e-e47e-4655-a30d-5f8d52772fba could not be found. Sep 06 01:18:56.973341 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-ec2a1125-d873-4329-992a-650608a4141a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Request method failure captured: Sep 06 01:18:56.973341 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: request: GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba HTTP/1.1 Sep 06 01:18:56.973341 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept: application/json Sep 06 01:18:56.973341 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept-Encoding: identity Sep 06 01:18:56.973341 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Connection: close Sep 06 01:18:56.973341 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Length: 0 Sep 06 01:18:56.973341 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Type: application/json Sep 06 01:18:56.973341 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Host: 10.222.0.23 Sep 06 01:18:56.973341 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Openstack-System-Scope: None Sep 06 01:18:56.973341 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: User-Agent: python-urllib3/1.26.12 Sep 06 01:18:56.973341 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Auth-Token: gAAAAABjFp6ScmWDY6l7TPFx_-ileNNzy-0TIvlQgL1o_EzXzNOdniRzn-Q3l_uLSFf7uv6gmkkLfBpFrrQPrRiOoZd0XJLC1l439UYTTcF-PMxKM89jtzOq5RKgPdvEksMIjlekHUzKLmQj2uw0iewtZ-i1W_EHF7V8nHnuSbe2RR5Koil9CFE Sep 06 01:18:56.973341 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Id: None Sep 06 01:18:56.973341 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Name: None Sep 06 01:18:56.973341 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Identity-Status: Confirmed Sep 06 01:18:56.973341 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Is-Admin-Project: True Sep 06 01:18:56.973341 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Id: default Sep 06 01:18:56.973341 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Name: Default Sep 06 01:18:56.973341 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Id: 80cfec738cab491ba413e062b5a00813 Sep 06 01:18:56.973341 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Name: tempest-AttachVolumeTestJSON-1010990594 Sep 06 01:18:56.973341 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Role: reader,member Sep 06 01:18:56.973341 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Roles: reader,member Sep 06 01:18:56.974638 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/80cfec738cab491ba413e062b5a00813"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/80cfec738cab491ba413e062b5a00813"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_80cfec738cab491ba413e062b5a00813"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/80cfec738cab491ba413e062b5a00813"}]}] Sep 06 01:18:56.974638 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant: tempest-AttachVolumeTestJSON-1010990594 Sep 06 01:18:56.974638 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Id: 80cfec738cab491ba413e062b5a00813 Sep 06 01:18:56.974638 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1010990594 Sep 06 01:18:56.974638 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User: tempest-AttachVolumeTestJSON-1010990594-project Sep 06 01:18:56.974638 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Id: default Sep 06 01:18:56.974638 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Name: Default Sep 06 01:18:56.974638 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Id: e17a4e664b2c4ac9a9fea65287faad95 Sep 06 01:18:56.974638 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Name: tempest-AttachVolumeTestJSON-1010990594-project Sep 06 01:18:56.974638 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: method: > Sep 06 01:18:56.974638 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: exception: Instance c116182e-e47e-4655-a30d-5f8d52772fba could not be found. Sep 06 01:18:56.974638 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: action_args: {'id': 'c116182e-e47e-4655-a30d-5f8d52772fba'} Sep 06 01:18:56.975461 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:18:56.975461 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:56.975461 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 01:18:56.975461 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 01:18:56.975461 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 01:18:56.975461 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 01:18:56.975461 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 01:18:56.975461 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 01:18:56.975461 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 01:18:56.975461 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 01:18:56.975461 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c116182e-e47e-4655-a30d-5f8d52772fba could not be found. Sep 06 01:18:56.975461 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:56.975461 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:56.975461 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:56.975461 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:56.975461 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:56.975461 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:56.975461 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:18:56.975461 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:18:56.975461 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:18:56.976704 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:18:56.976704 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 01:18:56.976704 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 01:18:56.976704 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 01:18:56.976704 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 01:18:56.976704 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 01:18:56.976704 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:18:56.976704 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c116182e-e47e-4655-a30d-5f8d52772fba could not be found. Sep 06 01:18:56.976704 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:56.976704 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:56.976704 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:56.976704 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:56.976704 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:56.976704 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:56.976704 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:18:56.976704 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:18:56.976704 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c116182e-e47e-4655-a30d-5f8d52772fba could not be found. Sep 06 01:18:56.976704 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:56.977851 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-ec2a1125-d873-4329-992a-650608a4141a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] Returning 404 to user: Instance c116182e-e47e-4655-a30d-5f8d52772fba could not be found. {{(pid=120580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:18:56.977851 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-ec2a1125-d873-4329-992a-650608a4141a tempest-AttachVolumeTestJSON-1010990594 tempest-AttachVolumeTestJSON-1010990594-project] 10.222.0.23 "GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba" status: 404 len: 111 microversion: 2.1 time: 0.036366 Sep 06 01:18:56.977851 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 534/1032] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:18:56 2022] GET /compute/v2.1/servers/c116182e-e47e-4655-a30d-5f8d52772fba => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 01:18:57.620836 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-56f58393-4277-408c-98e0-b967fbf74e53 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:57.621448 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-56f58393-4277-408c-98e0-b967fbf74e53 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:57.627230 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-56f58393-4277-408c-98e0-b967fbf74e53 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:57.627804 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-56f58393-4277-408c-98e0-b967fbf74e53 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:57.628256 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-56f58393-4277-408c-98e0-b967fbf74e53 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:57.628926 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-56f58393-4277-408c-98e0-b967fbf74e53 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:57.629373 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-56f58393-4277-408c-98e0-b967fbf74e53 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:57.629788 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-56f58393-4277-408c-98e0-b967fbf74e53 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:57.642985 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-56f58393-4277-408c-98e0-b967fbf74e53 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] HTTP exception thrown: Instance 366390df-669b-48b1-b741-56d5fdd64441 could not be found. Sep 06 01:18:57.644542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-56f58393-4277-408c-98e0-b967fbf74e53 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Request method failure captured: Sep 06 01:18:57.644542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 HTTP/1.1 Sep 06 01:18:57.644542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept: application/json Sep 06 01:18:57.644542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept-Encoding: identity Sep 06 01:18:57.644542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Connection: close Sep 06 01:18:57.644542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Length: 0 Sep 06 01:18:57.644542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Type: application/json Sep 06 01:18:57.644542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Host: 10.222.0.23 Sep 06 01:18:57.644542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Openstack-System-Scope: None Sep 06 01:18:57.644542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Sep 06 01:18:57.644542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjFp5Jd8tx02fVidBaBnu-tf9SqWjO3jnfzKjDhWmOsqgzVcujsHvhG9DLM-9PrGpJG5qdT7IdxHca8UUwPoYffUs9KdEuslWnHY3r_drNtbTZucfHaK6FuPy4dVD0Cvi2Id4jiWbo0XFkjIVQdjNM3FOOqntUj2-Cl0QwEXuE8Co1F1o Sep 06 01:18:57.644542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Id: None Sep 06 01:18:57.644542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Name: None Sep 06 01:18:57.644542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Identity-Status: Confirmed Sep 06 01:18:57.644542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Is-Admin-Project: True Sep 06 01:18:57.644542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 01:18:57.644542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Id: default Sep 06 01:18:57.644542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Name: Default Sep 06 01:18:57.644542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Id: 1c096a50088a4b8dbd00458b324f301e Sep 06 01:18:57.644542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2103393715 Sep 06 01:18:57.644542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Role: reader,member Sep 06 01:18:57.644542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Roles: reader,member Sep 06 01:18:57.646216 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c096a50088a4b8dbd00458b324f301e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1c096a50088a4b8dbd00458b324f301e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1c096a50088a4b8dbd00458b324f301e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c096a50088a4b8dbd00458b324f301e"}]}] Sep 06 01:18:57.646216 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2103393715 Sep 06 01:18:57.646216 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Id: 1c096a50088a4b8dbd00458b324f301e Sep 06 01:18:57.646216 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2103393715 Sep 06 01:18:57.646216 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User: tempest-AttachVolumeShelveTestJSON-2103393715-project Sep 06 01:18:57.646216 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Id: default Sep 06 01:18:57.646216 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Name: Default Sep 06 01:18:57.646216 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Id: 2dc5c46544a447159b7fd3d225cd9697 Sep 06 01:18:57.646216 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2103393715-project Sep 06 01:18:57.646216 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: method: > Sep 06 01:18:57.646216 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: exception: Instance 366390df-669b-48b1-b741-56d5fdd64441 could not be found. Sep 06 01:18:57.646216 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: action_args: {'id': '366390df-669b-48b1-b741-56d5fdd64441'} Sep 06 01:18:57.646997 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:18:57.646997 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:57.646997 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 01:18:57.646997 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 01:18:57.646997 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 01:18:57.646997 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 01:18:57.646997 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 01:18:57.646997 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 01:18:57.646997 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 01:18:57.646997 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 01:18:57.646997 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 366390df-669b-48b1-b741-56d5fdd64441 could not be found. Sep 06 01:18:57.646997 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:57.646997 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:57.646997 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:57.646997 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:57.646997 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:57.646997 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:57.646997 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:18:57.646997 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:18:57.646997 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:18:57.648224 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:18:57.648224 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 01:18:57.648224 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 01:18:57.648224 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 01:18:57.648224 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 01:18:57.648224 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 01:18:57.648224 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 01:18:57.648224 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 01:18:57.648224 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:18:57.648224 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 366390df-669b-48b1-b741-56d5fdd64441 could not be found. Sep 06 01:18:57.648224 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:57.648224 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:57.648224 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:57.648224 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:57.648224 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:57.648224 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:57.648224 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:18:57.648224 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:18:57.648224 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 366390df-669b-48b1-b741-56d5fdd64441 could not be found. Sep 06 01:18:57.648224 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:18:57.649407 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-56f58393-4277-408c-98e0-b967fbf74e53 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Returning 404 to user: Instance 366390df-669b-48b1-b741-56d5fdd64441 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:18:57.649407 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-56f58393-4277-408c-98e0-b967fbf74e53 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "DELETE /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 404 len: 111 microversion: 2.20 time: 0.028952 Sep 06 01:18:57.649407 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 499/1033] 10.222.0.23 () {60 vars in 1280 bytes} [Tue Sep 6 01:18:57 2022] DELETE /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 06 01:18:57.655029 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-528dbfa4-9de3-4f19-be0b-a017fd48217d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:18:57.655717 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-528dbfa4-9de3-4f19-be0b-a017fd48217d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: 366390df-669b-48b1-b741-56d5fdd64441] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:18:57.662209 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-528dbfa4-9de3-4f19-be0b-a017fd48217d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:57.662769 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-528dbfa4-9de3-4f19-be0b-a017fd48217d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:57.663277 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-528dbfa4-9de3-4f19-be0b-a017fd48217d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:57.664087 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-528dbfa4-9de3-4f19-be0b-a017fd48217d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:18:57.664619 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-528dbfa4-9de3-4f19-be0b-a017fd48217d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:18:57.665117 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-528dbfa4-9de3-4f19-be0b-a017fd48217d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:18:57.679250 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.wsgi [None req-528dbfa4-9de3-4f19-be0b-a017fd48217d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] HTTP exception thrown: Instance 366390df-669b-48b1-b741-56d5fdd64441 could not be found. Sep 06 01:18:57.680897 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-528dbfa4-9de3-4f19-be0b-a017fd48217d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Request method failure captured: Sep 06 01:18:57.680897 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: request: GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 HTTP/1.1 Sep 06 01:18:57.680897 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept: application/json Sep 06 01:18:57.680897 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept-Encoding: identity Sep 06 01:18:57.680897 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Connection: close Sep 06 01:18:57.680897 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Length: 0 Sep 06 01:18:57.680897 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Type: application/json Sep 06 01:18:57.680897 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Host: 10.222.0.23 Sep 06 01:18:57.680897 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Openstack-System-Scope: None Sep 06 01:18:57.680897 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: User-Agent: python-urllib3/1.26.12 Sep 06 01:18:57.680897 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Auth-Token: gAAAAABjFp5Jd8tx02fVidBaBnu-tf9SqWjO3jnfzKjDhWmOsqgzVcujsHvhG9DLM-9PrGpJG5qdT7IdxHca8UUwPoYffUs9KdEuslWnHY3r_drNtbTZucfHaK6FuPy4dVD0Cvi2Id4jiWbo0XFkjIVQdjNM3FOOqntUj2-Cl0QwEXuE8Co1F1o Sep 06 01:18:57.680897 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Id: None Sep 06 01:18:57.680897 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Name: None Sep 06 01:18:57.680897 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Identity-Status: Confirmed Sep 06 01:18:57.680897 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Is-Admin-Project: True Sep 06 01:18:57.680897 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 01:18:57.680897 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Id: default Sep 06 01:18:57.680897 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Name: Default Sep 06 01:18:57.680897 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Id: 1c096a50088a4b8dbd00458b324f301e Sep 06 01:18:57.680897 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2103393715 Sep 06 01:18:57.680897 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Role: reader,member Sep 06 01:18:57.680897 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Roles: reader,member Sep 06 01:18:57.682358 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c096a50088a4b8dbd00458b324f301e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1c096a50088a4b8dbd00458b324f301e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1c096a50088a4b8dbd00458b324f301e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c096a50088a4b8dbd00458b324f301e"}]}] Sep 06 01:18:57.682358 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2103393715 Sep 06 01:18:57.682358 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Id: 1c096a50088a4b8dbd00458b324f301e Sep 06 01:18:57.682358 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2103393715 Sep 06 01:18:57.682358 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User: tempest-AttachVolumeShelveTestJSON-2103393715-project Sep 06 01:18:57.682358 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Id: default Sep 06 01:18:57.682358 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Name: Default Sep 06 01:18:57.682358 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Id: 2dc5c46544a447159b7fd3d225cd9697 Sep 06 01:18:57.682358 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2103393715-project Sep 06 01:18:57.682358 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: method: > Sep 06 01:18:57.682358 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: exception: Instance 366390df-669b-48b1-b741-56d5fdd64441 could not be found. Sep 06 01:18:57.682358 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: action_args: {'id': '366390df-669b-48b1-b741-56d5fdd64441'} Sep 06 01:18:57.683092 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:18:57.683092 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:57.683092 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 01:18:57.683092 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 01:18:57.683092 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 01:18:57.683092 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 01:18:57.683092 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 01:18:57.683092 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 01:18:57.683092 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 01:18:57.683092 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 01:18:57.683092 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 366390df-669b-48b1-b741-56d5fdd64441 could not be found. Sep 06 01:18:57.683092 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:57.683092 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:57.683092 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:57.683092 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:57.683092 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:57.683092 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:57.683092 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:18:57.683092 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:18:57.683092 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:18:57.684328 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:18:57.684328 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 01:18:57.684328 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 01:18:57.684328 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 01:18:57.684328 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 01:18:57.684328 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 01:18:57.684328 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:18:57.684328 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 366390df-669b-48b1-b741-56d5fdd64441 could not be found. Sep 06 01:18:57.684328 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:57.684328 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:18:57.684328 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:57.684328 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:18:57.684328 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:18:57.684328 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:18:57.684328 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:18:57.684328 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:18:57.684328 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 366390df-669b-48b1-b741-56d5fdd64441 could not be found. Sep 06 01:18:57.684328 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:18:57.685397 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-528dbfa4-9de3-4f19-be0b-a017fd48217d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Returning 404 to user: Instance 366390df-669b-48b1-b741-56d5fdd64441 could not be found. {{(pid=120580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:18:57.685397 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-528dbfa4-9de3-4f19-be0b-a017fd48217d tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441" status: 404 len: 111 microversion: 2.20 time: 0.031612 Sep 06 01:18:57.685397 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 535/1034] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:18:57 2022] GET /compute/v2.1/servers/366390df-669b-48b1-b741-56d5fdd64441 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 01:19:00.941600 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3c712f0c-f0ab-4152-aed9-7c84bf389d48 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:19:00.942104 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3c712f0c-f0ab-4152-aed9-7c84bf389d48 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:19:00.948447 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c712f0c-f0ab-4152-aed9-7c84bf389d48 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:19:00.948927 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c712f0c-f0ab-4152-aed9-7c84bf389d48 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:19:00.949359 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c712f0c-f0ab-4152-aed9-7c84bf389d48 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:19:00.950042 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c712f0c-f0ab-4152-aed9-7c84bf389d48 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:19:00.950492 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c712f0c-f0ab-4152-aed9-7c84bf389d48 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:19:00.950909 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c712f0c-f0ab-4152-aed9-7c84bf389d48 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:19:00.964524 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-3c712f0c-f0ab-4152-aed9-7c84bf389d48 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] HTTP exception thrown: Instance c42df4ca-a678-4b12-b5dc-3f3c0af93125 could not be found. Sep 06 01:19:00.966077 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3c712f0c-f0ab-4152-aed9-7c84bf389d48 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Request method failure captured: Sep 06 01:19:00.966077 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 HTTP/1.1 Sep 06 01:19:00.966077 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept: application/json Sep 06 01:19:00.966077 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept-Encoding: identity Sep 06 01:19:00.966077 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Connection: close Sep 06 01:19:00.966077 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Length: 0 Sep 06 01:19:00.966077 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Type: application/json Sep 06 01:19:00.966077 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Host: 10.222.0.23 Sep 06 01:19:00.966077 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Openstack-System-Scope: None Sep 06 01:19:00.966077 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Sep 06 01:19:00.966077 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjFp5Jd8tx02fVidBaBnu-tf9SqWjO3jnfzKjDhWmOsqgzVcujsHvhG9DLM-9PrGpJG5qdT7IdxHca8UUwPoYffUs9KdEuslWnHY3r_drNtbTZucfHaK6FuPy4dVD0Cvi2Id4jiWbo0XFkjIVQdjNM3FOOqntUj2-Cl0QwEXuE8Co1F1o Sep 06 01:19:00.966077 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Id: None Sep 06 01:19:00.966077 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Name: None Sep 06 01:19:00.966077 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Identity-Status: Confirmed Sep 06 01:19:00.966077 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Is-Admin-Project: True Sep 06 01:19:00.966077 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 01:19:00.966077 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Id: default Sep 06 01:19:00.966077 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Name: Default Sep 06 01:19:00.966077 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Id: 1c096a50088a4b8dbd00458b324f301e Sep 06 01:19:00.966077 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2103393715 Sep 06 01:19:00.966077 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Role: reader,member Sep 06 01:19:00.966077 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Roles: reader,member Sep 06 01:19:00.967576 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c096a50088a4b8dbd00458b324f301e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1c096a50088a4b8dbd00458b324f301e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1c096a50088a4b8dbd00458b324f301e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c096a50088a4b8dbd00458b324f301e"}]}] Sep 06 01:19:00.967576 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2103393715 Sep 06 01:19:00.967576 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Id: 1c096a50088a4b8dbd00458b324f301e Sep 06 01:19:00.967576 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2103393715 Sep 06 01:19:00.967576 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User: tempest-AttachVolumeShelveTestJSON-2103393715-project Sep 06 01:19:00.967576 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Id: default Sep 06 01:19:00.967576 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Name: Default Sep 06 01:19:00.967576 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Id: 2dc5c46544a447159b7fd3d225cd9697 Sep 06 01:19:00.967576 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2103393715-project Sep 06 01:19:00.967576 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: method: > Sep 06 01:19:00.967576 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: exception: Instance c42df4ca-a678-4b12-b5dc-3f3c0af93125 could not be found. Sep 06 01:19:00.967576 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: action_args: {'id': 'c42df4ca-a678-4b12-b5dc-3f3c0af93125'} Sep 06 01:19:00.968625 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:19:00.968625 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:19:00.968625 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 01:19:00.968625 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 01:19:00.968625 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 01:19:00.968625 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 01:19:00.968625 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 01:19:00.968625 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 01:19:00.968625 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 01:19:00.968625 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 01:19:00.968625 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c42df4ca-a678-4b12-b5dc-3f3c0af93125 could not be found. Sep 06 01:19:00.968625 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:19:00.968625 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:19:00.968625 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:19:00.968625 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:19:00.968625 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:19:00.968625 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:19:00.968625 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:19:00.968625 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:19:00.968625 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:19:00.969794 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:19:00.969794 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 01:19:00.969794 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 01:19:00.969794 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 01:19:00.969794 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 01:19:00.969794 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 01:19:00.969794 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 01:19:00.969794 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 01:19:00.969794 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:19:00.969794 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c42df4ca-a678-4b12-b5dc-3f3c0af93125 could not be found. Sep 06 01:19:00.969794 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:19:00.969794 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:19:00.969794 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:19:00.969794 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:19:00.969794 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:19:00.969794 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:19:00.969794 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:19:00.969794 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:19:00.969794 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c42df4ca-a678-4b12-b5dc-3f3c0af93125 could not be found. Sep 06 01:19:00.969794 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:19:00.971011 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3c712f0c-f0ab-4152-aed9-7c84bf389d48 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Returning 404 to user: Instance c42df4ca-a678-4b12-b5dc-3f3c0af93125 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:19:00.971011 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3c712f0c-f0ab-4152-aed9-7c84bf389d48 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 404 len: 111 microversion: 2.20 time: 0.029721 Sep 06 01:19:00.976384 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-f48bed51-d4fa-4d8f-821f-13a854d7ab96 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:19:00.976989 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-f48bed51-d4fa-4d8f-821f-13a854d7ab96 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] [instance: c42df4ca-a678-4b12-b5dc-3f3c0af93125] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:19:00.980754 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 500/1035] 10.222.0.23 () {60 vars in 1280 bytes} [Tue Sep 6 01:19:00 2022] DELETE /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 01:19:00.983795 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f48bed51-d4fa-4d8f-821f-13a854d7ab96 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:19:00.984261 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f48bed51-d4fa-4d8f-821f-13a854d7ab96 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:19:00.984691 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f48bed51-d4fa-4d8f-821f-13a854d7ab96 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:19:00.985371 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f48bed51-d4fa-4d8f-821f-13a854d7ab96 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:19:00.985819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f48bed51-d4fa-4d8f-821f-13a854d7ab96 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:19:00.986238 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f48bed51-d4fa-4d8f-821f-13a854d7ab96 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:19:00.999569 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.wsgi [None req-f48bed51-d4fa-4d8f-821f-13a854d7ab96 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] HTTP exception thrown: Instance c42df4ca-a678-4b12-b5dc-3f3c0af93125 could not be found. Sep 06 01:19:01.001141 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-f48bed51-d4fa-4d8f-821f-13a854d7ab96 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Request method failure captured: Sep 06 01:19:01.001141 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: request: GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 HTTP/1.1 Sep 06 01:19:01.001141 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept: application/json Sep 06 01:19:01.001141 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept-Encoding: identity Sep 06 01:19:01.001141 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Connection: close Sep 06 01:19:01.001141 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Length: 0 Sep 06 01:19:01.001141 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Type: application/json Sep 06 01:19:01.001141 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Host: 10.222.0.23 Sep 06 01:19:01.001141 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Openstack-System-Scope: None Sep 06 01:19:01.001141 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: User-Agent: python-urllib3/1.26.12 Sep 06 01:19:01.001141 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Auth-Token: gAAAAABjFp5Jd8tx02fVidBaBnu-tf9SqWjO3jnfzKjDhWmOsqgzVcujsHvhG9DLM-9PrGpJG5qdT7IdxHca8UUwPoYffUs9KdEuslWnHY3r_drNtbTZucfHaK6FuPy4dVD0Cvi2Id4jiWbo0XFkjIVQdjNM3FOOqntUj2-Cl0QwEXuE8Co1F1o Sep 06 01:19:01.001141 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Id: None Sep 06 01:19:01.001141 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Name: None Sep 06 01:19:01.001141 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Identity-Status: Confirmed Sep 06 01:19:01.001141 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Is-Admin-Project: True Sep 06 01:19:01.001141 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 01:19:01.001141 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Id: default Sep 06 01:19:01.001141 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Name: Default Sep 06 01:19:01.001141 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Id: 1c096a50088a4b8dbd00458b324f301e Sep 06 01:19:01.001141 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2103393715 Sep 06 01:19:01.001141 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Role: reader,member Sep 06 01:19:01.001141 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Roles: reader,member Sep 06 01:19:01.002799 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c096a50088a4b8dbd00458b324f301e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1c096a50088a4b8dbd00458b324f301e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1c096a50088a4b8dbd00458b324f301e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c096a50088a4b8dbd00458b324f301e"}]}] Sep 06 01:19:01.002799 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2103393715 Sep 06 01:19:01.002799 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Id: 1c096a50088a4b8dbd00458b324f301e Sep 06 01:19:01.002799 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2103393715 Sep 06 01:19:01.002799 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User: tempest-AttachVolumeShelveTestJSON-2103393715-project Sep 06 01:19:01.002799 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Id: default Sep 06 01:19:01.002799 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Name: Default Sep 06 01:19:01.002799 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Id: 2dc5c46544a447159b7fd3d225cd9697 Sep 06 01:19:01.002799 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2103393715-project Sep 06 01:19:01.002799 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: method: > Sep 06 01:19:01.002799 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: exception: Instance c42df4ca-a678-4b12-b5dc-3f3c0af93125 could not be found. Sep 06 01:19:01.002799 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: action_args: {'id': 'c42df4ca-a678-4b12-b5dc-3f3c0af93125'} Sep 06 01:19:01.003676 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:19:01.003676 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:19:01.003676 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 01:19:01.003676 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 01:19:01.003676 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 01:19:01.003676 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 01:19:01.003676 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 01:19:01.003676 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 01:19:01.003676 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 01:19:01.003676 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 01:19:01.003676 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c42df4ca-a678-4b12-b5dc-3f3c0af93125 could not be found. Sep 06 01:19:01.003676 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:19:01.003676 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:19:01.003676 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:19:01.003676 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:19:01.003676 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:19:01.003676 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:19:01.003676 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:19:01.003676 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:19:01.003676 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:19:01.004978 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:19:01.004978 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 01:19:01.004978 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 01:19:01.004978 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 01:19:01.004978 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 01:19:01.004978 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 01:19:01.004978 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:19:01.004978 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c42df4ca-a678-4b12-b5dc-3f3c0af93125 could not be found. Sep 06 01:19:01.004978 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:19:01.004978 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:19:01.004978 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:19:01.004978 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:19:01.004978 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:19:01.004978 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:19:01.004978 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:19:01.004978 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:19:01.004978 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c42df4ca-a678-4b12-b5dc-3f3c0af93125 could not be found. Sep 06 01:19:01.004978 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:19:01.006202 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-f48bed51-d4fa-4d8f-821f-13a854d7ab96 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] Returning 404 to user: Instance c42df4ca-a678-4b12-b5dc-3f3c0af93125 could not be found. {{(pid=120580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:19:01.006202 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-f48bed51-d4fa-4d8f-821f-13a854d7ab96 tempest-AttachVolumeShelveTestJSON-2103393715 tempest-AttachVolumeShelveTestJSON-2103393715-project] 10.222.0.23 "GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125" status: 404 len: 111 microversion: 2.20 time: 0.029898 Sep 06 01:19:01.006202 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 536/1036] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 6 01:19:00 2022] GET /compute/v2.1/servers/c42df4ca-a678-4b12-b5dc-3f3c0af93125 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 01:20:09.193749 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=13 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:20:09.194583 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:20:09.195815 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 01:20:09.196063 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Tue Sep 6 01:20:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.23) !!! Sep 06 01:20:09.437400 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9b5b4c26-3f26-4e9b-9d0e-bd5d0580ae2c tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Action: 'create', calling method: .version_select at 0x7fb06e143700>, body: {"keypair": {"name": "tempest-TestShelveInstance-832861560", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhC5Rfvx/G/n7mtRNSLT7gc6s9d0be78O6S/xPhQmrIrX6s0yx0BbJS2h7NJnEuLUoAxjieuZEKzw7DGr0quIYUdbyOb7C7TbqXhOLW2SCgmkLh1l/n5WClhb6ysj422Q=="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:20:09.454418 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.quota [None req-9b5b4c26-3f26-4e9b-9d0e-bd5d0580ae2c tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Getting quotas for project dfa07fc2740842a98113dcae8f46cc7c. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 01:20:09.458401 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.quota [None req-9b5b4c26-3f26-4e9b-9d0e-bd5d0580ae2c tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Getting quotas for user 258826592903462eb4a9274e96589bc9 and project dfa07fc2740842a98113dcae8f46cc7c. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 01:20:09.483896 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9b5b4c26-3f26-4e9b-9d0e-bd5d0580ae2c tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.291659 Sep 06 01:20:09.484746 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 501/1037] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Sep 6 01:20:09 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 01:20:24.681365 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=2 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:20:24.682083 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell1:SELECT=53 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:20:24.683450 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 01:20:24.683617 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Tue Sep 6 01:20:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Sep 06 01:20:24.687777 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-04f8d090-5dcc-4922-88cb-c8a2cece78c5 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-52225990", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-832861560", "security_groups": [{"name": "tempest-secgroup-smoke-796207285"}], "networks": [{"uuid": "afd90faf-7be4-4f50-8ff0-908dba6d11cd"}], "block_device_mapping_v2": [{"uuid": "d58913c6-1536-481e-b6c8-f38ad752109d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:20:24.803226 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.network.neutron [None req-04f8d090-5dcc-4922-88cb-c8a2cece78c5 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] validate_networks() for [('afd90faf-7be4-4f50-8ff0-908dba6d11cd', None, None, None, None, None)] {{(pid=120580) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 01:20:25.161785 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-04f8d090-5dcc-4922-88cb-c8a2cece78c5 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Flavor limits 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 01:20:25.162212 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-04f8d090-5dcc-4922-88cb-c8a2cece78c5 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Image limits 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 01:20:25.162689 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-04f8d090-5dcc-4922-88cb-c8a2cece78c5 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Flavor pref 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 01:20:25.163101 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-04f8d090-5dcc-4922-88cb-c8a2cece78c5 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Image pref 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 01:20:25.163516 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-04f8d090-5dcc-4922-88cb-c8a2cece78c5 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 01:20:25.172545 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-04f8d090-5dcc-4922-88cb-c8a2cece78c5 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:20:25.173026 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-04f8d090-5dcc-4922-88cb-c8a2cece78c5 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:20:25.173511 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-04f8d090-5dcc-4922-88cb-c8a2cece78c5 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:20:25.174242 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-04f8d090-5dcc-4922-88cb-c8a2cece78c5 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:20:25.174695 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-04f8d090-5dcc-4922-88cb-c8a2cece78c5 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:20:25.175123 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-04f8d090-5dcc-4922-88cb-c8a2cece78c5 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:20:25.191653 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.quota [None req-04f8d090-5dcc-4922-88cb-c8a2cece78c5 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Getting quotas for project dfa07fc2740842a98113dcae8f46cc7c. Resources: {'instances', 'ram', 'cores'} {{(pid=120580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 01:20:25.195547 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.quota [None req-04f8d090-5dcc-4922-88cb-c8a2cece78c5 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Getting quotas for user 258826592903462eb4a9274e96589bc9 and project dfa07fc2740842a98113dcae8f46cc7c. Resources: {'instances', 'ram', 'cores'} {{(pid=120580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 01:20:25.252844 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-04f8d090-5dcc-4922-88cb-c8a2cece78c5 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Going to run 1 instances... {{(pid=120580) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 01:20:25.254972 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-04f8d090-5dcc-4922-88cb-c8a2cece78c5 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d58913c6-1536-481e-b6c8-f38ad752109d',volume_size=None,volume_type=None)] {{(pid=120580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 01:20:25.383530 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-04f8d090-5dcc-4922-88cb-c8a2cece78c5 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.703917 Sep 06 01:20:25.384203 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 537/1038] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Sep 6 01:20:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 01:20:25.393508 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=4 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:20:25.394748 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:20:25.398630 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-60eed66d-652d-495e-bb16-4e0d0ef724eb tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:20:25.399399 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-60eed66d-652d-495e-bb16-4e0d0ef724eb tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:20:25.453814 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-60eed66d-652d-495e-bb16-4e0d0ef724eb tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258826592903462eb4a9274e96589bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa07fc2740842a98113dcae8f46cc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:20:25.461223 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-60eed66d-652d-495e-bb16-4e0d0ef724eb tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 200 len: 1086 microversion: 2.1 time: 0.069785 Sep 06 01:20:25.461775 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 502/1039] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:20:25 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 1086 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:20:26.484704 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-f1ddc2d4-0369-4623-aa6c-acc190acfb91 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:20:26.485676 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-f1ddc2d4-0369-4623-aa6c-acc190acfb91 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:20:26.492356 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f1ddc2d4-0369-4623-aa6c-acc190acfb91 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:20:26.493064 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f1ddc2d4-0369-4623-aa6c-acc190acfb91 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:20:26.493502 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f1ddc2d4-0369-4623-aa6c-acc190acfb91 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:20:26.494190 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f1ddc2d4-0369-4623-aa6c-acc190acfb91 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:20:26.494639 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f1ddc2d4-0369-4623-aa6c-acc190acfb91 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:20:26.495114 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-f1ddc2d4-0369-4623-aa6c-acc190acfb91 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:20:26.561748 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-f1ddc2d4-0369-4623-aa6c-acc190acfb91 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258826592903462eb4a9274e96589bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa07fc2740842a98113dcae8f46cc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:20:26.569645 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-f1ddc2d4-0369-4623-aa6c-acc190acfb91 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 200 len: 1192 microversion: 2.1 time: 0.089503 Sep 06 01:20:26.570603 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 538/1040] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:20:26 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 1192 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:20:27.593742 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6b340b7d-0b14-414f-9f51-a3538377b578 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:20:27.594364 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6b340b7d-0b14-414f-9f51-a3538377b578 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:20:27.601983 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b340b7d-0b14-414f-9f51-a3538377b578 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:20:27.602462 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b340b7d-0b14-414f-9f51-a3538377b578 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:20:27.602890 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b340b7d-0b14-414f-9f51-a3538377b578 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:20:27.603573 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b340b7d-0b14-414f-9f51-a3538377b578 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:20:27.604053 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b340b7d-0b14-414f-9f51-a3538377b578 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:20:27.604471 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b340b7d-0b14-414f-9f51-a3538377b578 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:20:27.734549 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-6b340b7d-0b14-414f-9f51-a3538377b578 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258826592903462eb4a9274e96589bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa07fc2740842a98113dcae8f46cc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:20:27.742237 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6b340b7d-0b14-414f-9f51-a3538377b578 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 200 len: 1257 microversion: 2.1 time: 0.152552 Sep 06 01:20:27.742798 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 503/1041] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:20:27 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 1257 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:20:27.857432 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-0dec6c68-63c8-4f08-a399-ad5cfc1a8644 req-76a1c8c4-8f0e-44e4-96b6-cc0ee98c2db7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c92d824-4c34-47bb-8f1a-237fbc1da8db", "tag": "e66b5c8c-3f4c-4245-ba50-acda95cbc070"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:20:27.869447 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-0dec6c68-63c8-4f08-a399-ad5cfc1a8644 req-76a1c8c4-8f0e-44e4-96b6-cc0ee98c2db7 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:20:27.870027 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-0dec6c68-63c8-4f08-a399-ad5cfc1a8644 req-76a1c8c4-8f0e-44e4-96b6-cc0ee98c2db7 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:20:27.870529 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-0dec6c68-63c8-4f08-a399-ad5cfc1a8644 req-76a1c8c4-8f0e-44e4-96b6-cc0ee98c2db7 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:20:27.884706 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.compute.server_external_events [req-0dec6c68-63c8-4f08-a399-ad5cfc1a8644 req-76a1c8c4-8f0e-44e4-96b6-cc0ee98c2db7 service nova] Creating event network-changed:e66b5c8c-3f4c-4245-ba50-acda95cbc070 for instance 1c92d824-4c34-47bb-8f1a-237fbc1da8db on hv-cinder-84773 Sep 06 01:20:27.889648 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [req-0dec6c68-63c8-4f08-a399-ad5cfc1a8644 req-76a1c8c4-8f0e-44e4-96b6-cc0ee98c2db7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036026 Sep 06 01:20:27.890423 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 539/1042] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:20:28.765493 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1cc7c7c0-8827-4d54-80a7-2a620327cf14 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:20:28.766033 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1cc7c7c0-8827-4d54-80a7-2a620327cf14 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:20:28.773331 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1cc7c7c0-8827-4d54-80a7-2a620327cf14 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:20:28.773935 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1cc7c7c0-8827-4d54-80a7-2a620327cf14 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:20:28.774597 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1cc7c7c0-8827-4d54-80a7-2a620327cf14 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:20:28.775195 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1cc7c7c0-8827-4d54-80a7-2a620327cf14 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:20:28.775789 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1cc7c7c0-8827-4d54-80a7-2a620327cf14 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:20:28.776214 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1cc7c7c0-8827-4d54-80a7-2a620327cf14 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:20:28.930467 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-1cc7c7c0-8827-4d54-80a7-2a620327cf14 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258826592903462eb4a9274e96589bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa07fc2740842a98113dcae8f46cc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:20:28.938167 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1cc7c7c0-8827-4d54-80a7-2a620327cf14 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 200 len: 1257 microversion: 2.1 time: 0.176638 Sep 06 01:20:28.938729 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 504/1043] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:20:28 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 1257 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:20:29.964829 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-989c4102-9c0d-43b7-9fbd-e7a2c6084c1b tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:20:29.967819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-989c4102-9c0d-43b7-9fbd-e7a2c6084c1b tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:20:29.972485 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-989c4102-9c0d-43b7-9fbd-e7a2c6084c1b tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:20:29.972964 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-989c4102-9c0d-43b7-9fbd-e7a2c6084c1b tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:20:29.973409 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-989c4102-9c0d-43b7-9fbd-e7a2c6084c1b tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:20:29.974081 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-989c4102-9c0d-43b7-9fbd-e7a2c6084c1b tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:20:29.974530 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-989c4102-9c0d-43b7-9fbd-e7a2c6084c1b tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:20:29.974953 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-989c4102-9c0d-43b7-9fbd-e7a2c6084c1b tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:20:30.102860 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-989c4102-9c0d-43b7-9fbd-e7a2c6084c1b tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258826592903462eb4a9274e96589bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa07fc2740842a98113dcae8f46cc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:20:30.110589 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-989c4102-9c0d-43b7-9fbd-e7a2c6084c1b tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 200 len: 1257 microversion: 2.1 time: 0.150483 Sep 06 01:20:30.111146 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 540/1044] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:20:29 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 1257 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:20:31.132810 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5ee1be93-4584-4cd8-93eb-713d0ae966f5 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:20:31.133414 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5ee1be93-4584-4cd8-93eb-713d0ae966f5 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:20:31.139727 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ee1be93-4584-4cd8-93eb-713d0ae966f5 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:20:31.140223 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ee1be93-4584-4cd8-93eb-713d0ae966f5 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:20:31.140651 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ee1be93-4584-4cd8-93eb-713d0ae966f5 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:20:31.141327 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ee1be93-4584-4cd8-93eb-713d0ae966f5 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:20:31.141775 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ee1be93-4584-4cd8-93eb-713d0ae966f5 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:20:31.142748 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ee1be93-4584-4cd8-93eb-713d0ae966f5 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:20:31.273514 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-5ee1be93-4584-4cd8-93eb-713d0ae966f5 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258826592903462eb4a9274e96589bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa07fc2740842a98113dcae8f46cc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:20:31.281108 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5ee1be93-4584-4cd8-93eb-713d0ae966f5 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 200 len: 1257 microversion: 2.1 time: 0.152147 Sep 06 01:20:31.281664 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 505/1045] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:20:31 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 1257 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:20:32.304794 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-95b13993-a26c-4d27-890c-139998f63d72 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:20:32.305460 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-95b13993-a26c-4d27-890c-139998f63d72 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:20:32.311777 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-95b13993-a26c-4d27-890c-139998f63d72 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:20:32.312271 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-95b13993-a26c-4d27-890c-139998f63d72 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:20:32.312728 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-95b13993-a26c-4d27-890c-139998f63d72 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:20:32.313414 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-95b13993-a26c-4d27-890c-139998f63d72 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:20:32.313914 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-95b13993-a26c-4d27-890c-139998f63d72 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:20:32.314342 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-95b13993-a26c-4d27-890c-139998f63d72 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:20:32.441499 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-95b13993-a26c-4d27-890c-139998f63d72 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258826592903462eb4a9274e96589bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa07fc2740842a98113dcae8f46cc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:20:32.449218 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-95b13993-a26c-4d27-890c-139998f63d72 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 200 len: 1257 microversion: 2.1 time: 0.148305 Sep 06 01:20:32.449788 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 541/1046] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:20:32 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 1257 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:20:33.472265 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6fc350ac-bcfe-4683-b9ad-93395ecb9584 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:20:33.472868 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6fc350ac-bcfe-4683-b9ad-93395ecb9584 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:20:33.479237 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6fc350ac-bcfe-4683-b9ad-93395ecb9584 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:20:33.479715 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6fc350ac-bcfe-4683-b9ad-93395ecb9584 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:20:33.480170 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6fc350ac-bcfe-4683-b9ad-93395ecb9584 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:20:33.480846 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6fc350ac-bcfe-4683-b9ad-93395ecb9584 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:20:33.481293 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6fc350ac-bcfe-4683-b9ad-93395ecb9584 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:20:33.481707 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6fc350ac-bcfe-4683-b9ad-93395ecb9584 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:20:33.612772 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-6fc350ac-bcfe-4683-b9ad-93395ecb9584 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258826592903462eb4a9274e96589bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa07fc2740842a98113dcae8f46cc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:20:33.620424 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6fc350ac-bcfe-4683-b9ad-93395ecb9584 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 200 len: 1257 microversion: 2.1 time: 0.152679 Sep 06 01:20:33.620984 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 506/1047] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:20:33 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 1257 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:20:34.642914 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-b8259b36-359e-4a52-b05b-0d8e27916564 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:20:34.643567 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-b8259b36-359e-4a52-b05b-0d8e27916564 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:20:34.649954 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b8259b36-359e-4a52-b05b-0d8e27916564 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:20:34.650435 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b8259b36-359e-4a52-b05b-0d8e27916564 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:20:34.650869 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b8259b36-359e-4a52-b05b-0d8e27916564 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:20:34.651547 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b8259b36-359e-4a52-b05b-0d8e27916564 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:20:34.652019 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b8259b36-359e-4a52-b05b-0d8e27916564 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:20:34.652439 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b8259b36-359e-4a52-b05b-0d8e27916564 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:20:34.780714 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-b8259b36-359e-4a52-b05b-0d8e27916564 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258826592903462eb4a9274e96589bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa07fc2740842a98113dcae8f46cc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:20:34.788734 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-b8259b36-359e-4a52-b05b-0d8e27916564 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 200 len: 1257 microversion: 2.1 time: 0.149661 Sep 06 01:20:34.789552 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 542/1048] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:20:34 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 1257 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:20:35.811884 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3f1252ed-b904-4f90-93c9-33bd5b1180b1 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:20:35.812433 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3f1252ed-b904-4f90-93c9-33bd5b1180b1 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:20:35.814894 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:20:35.820876 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f1252ed-b904-4f90-93c9-33bd5b1180b1 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:20:35.821364 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f1252ed-b904-4f90-93c9-33bd5b1180b1 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:20:35.821839 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f1252ed-b904-4f90-93c9-33bd5b1180b1 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:20:35.822534 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f1252ed-b904-4f90-93c9-33bd5b1180b1 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:20:35.823013 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f1252ed-b904-4f90-93c9-33bd5b1180b1 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:20:35.823439 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f1252ed-b904-4f90-93c9-33bd5b1180b1 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:20:35.952585 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-3f1252ed-b904-4f90-93c9-33bd5b1180b1 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258826592903462eb4a9274e96589bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa07fc2740842a98113dcae8f46cc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:20:35.960270 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3f1252ed-b904-4f90-93c9-33bd5b1180b1 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 200 len: 1257 microversion: 2.1 time: 0.152328 Sep 06 01:20:35.960833 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 507/1049] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:20:35 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 1257 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:20:36.982376 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-ab58da0f-f62c-460a-8dc1-2fbcd9af0d8e tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:20:36.983084 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-ab58da0f-f62c-460a-8dc1-2fbcd9af0d8e tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:20:36.985133 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell0:SELECT=2 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:20:36.986744 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell0:SELECT=6 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:20:36.993952 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ab58da0f-f62c-460a-8dc1-2fbcd9af0d8e tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:20:36.994434 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ab58da0f-f62c-460a-8dc1-2fbcd9af0d8e tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:20:36.994870 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ab58da0f-f62c-460a-8dc1-2fbcd9af0d8e tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:20:36.995573 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ab58da0f-f62c-460a-8dc1-2fbcd9af0d8e tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:20:36.996051 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ab58da0f-f62c-460a-8dc1-2fbcd9af0d8e tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:20:36.996476 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-ab58da0f-f62c-460a-8dc1-2fbcd9af0d8e tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:20:37.137602 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-ab58da0f-f62c-460a-8dc1-2fbcd9af0d8e tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258826592903462eb4a9274e96589bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa07fc2740842a98113dcae8f46cc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:20:37.145737 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-ab58da0f-f62c-460a-8dc1-2fbcd9af0d8e tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 200 len: 1257 microversion: 2.1 time: 0.167196 Sep 06 01:20:37.146314 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 543/1050] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:20:36 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 1257 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:20:38.169200 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b121e859-803a-4c8f-a8ca-04ca5163b5b6 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:20:38.169810 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b121e859-803a-4c8f-a8ca-04ca5163b5b6 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:20:38.176953 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b121e859-803a-4c8f-a8ca-04ca5163b5b6 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:20:38.177432 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b121e859-803a-4c8f-a8ca-04ca5163b5b6 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:20:38.177870 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b121e859-803a-4c8f-a8ca-04ca5163b5b6 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:20:38.178557 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b121e859-803a-4c8f-a8ca-04ca5163b5b6 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:20:38.179011 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b121e859-803a-4c8f-a8ca-04ca5163b5b6 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:20:38.179465 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b121e859-803a-4c8f-a8ca-04ca5163b5b6 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:20:38.306358 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-b121e859-803a-4c8f-a8ca-04ca5163b5b6 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258826592903462eb4a9274e96589bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa07fc2740842a98113dcae8f46cc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:20:38.313888 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b121e859-803a-4c8f-a8ca-04ca5163b5b6 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 200 len: 1257 microversion: 2.1 time: 0.148557 Sep 06 01:20:38.314446 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 508/1051] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:20:38 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 1257 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:20:39.112529 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-29bcd706-8301-4f71-ba5d-f5bd409d4bf5 req-77efc7bb-916e-4cb7-9ebb-d05293e981c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c92d824-4c34-47bb-8f1a-237fbc1da8db", "name": "network-vif-plugged", "status": "completed", "tag": "e66b5c8c-3f4c-4245-ba50-acda95cbc070"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:20:39.127868 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-29bcd706-8301-4f71-ba5d-f5bd409d4bf5 req-77efc7bb-916e-4cb7-9ebb-d05293e981c6 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:20:39.128358 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-29bcd706-8301-4f71-ba5d-f5bd409d4bf5 req-77efc7bb-916e-4cb7-9ebb-d05293e981c6 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:20:39.128782 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-29bcd706-8301-4f71-ba5d-f5bd409d4bf5 req-77efc7bb-916e-4cb7-9ebb-d05293e981c6 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:20:39.139723 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.compute.server_external_events [req-29bcd706-8301-4f71-ba5d-f5bd409d4bf5 req-77efc7bb-916e-4cb7-9ebb-d05293e981c6 service nova] Creating event network-vif-plugged:e66b5c8c-3f4c-4245-ba50-acda95cbc070 for instance 1c92d824-4c34-47bb-8f1a-237fbc1da8db on hv-cinder-84773 Sep 06 01:20:39.145360 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [req-29bcd706-8301-4f71-ba5d-f5bd409d4bf5 req-77efc7bb-916e-4cb7-9ebb-d05293e981c6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036686 Sep 06 01:20:39.145943 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 544/1052] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:20:39.336459 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d5ce9b52-5a59-46ff-a8c6-7e5a8f039b68 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:20:39.336997 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d5ce9b52-5a59-46ff-a8c6-7e5a8f039b68 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:20:39.343450 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5ce9b52-5a59-46ff-a8c6-7e5a8f039b68 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:20:39.343965 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5ce9b52-5a59-46ff-a8c6-7e5a8f039b68 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:20:39.344399 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5ce9b52-5a59-46ff-a8c6-7e5a8f039b68 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:20:39.345084 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5ce9b52-5a59-46ff-a8c6-7e5a8f039b68 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:20:39.345533 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5ce9b52-5a59-46ff-a8c6-7e5a8f039b68 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:20:39.345949 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5ce9b52-5a59-46ff-a8c6-7e5a8f039b68 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:20:39.477599 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-d5ce9b52-5a59-46ff-a8c6-7e5a8f039b68 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258826592903462eb4a9274e96589bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa07fc2740842a98113dcae8f46cc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:20:39.485760 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d5ce9b52-5a59-46ff-a8c6-7e5a8f039b68 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 200 len: 1257 microversion: 2.1 time: 0.152760 Sep 06 01:20:39.486324 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 509/1053] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:20:39 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 1257 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:20:40.509155 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-1770270e-9eda-4916-8f0b-d8f59254b4e6 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:20:40.509890 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-1770270e-9eda-4916-8f0b-d8f59254b4e6 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:20:40.516541 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1770270e-9eda-4916-8f0b-d8f59254b4e6 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:20:40.517022 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1770270e-9eda-4916-8f0b-d8f59254b4e6 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:20:40.517456 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1770270e-9eda-4916-8f0b-d8f59254b4e6 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:20:40.518140 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1770270e-9eda-4916-8f0b-d8f59254b4e6 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:20:40.518591 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1770270e-9eda-4916-8f0b-d8f59254b4e6 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:20:40.519015 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-1770270e-9eda-4916-8f0b-d8f59254b4e6 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:20:40.653003 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-1770270e-9eda-4916-8f0b-d8f59254b4e6 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258826592903462eb4a9274e96589bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa07fc2740842a98113dcae8f46cc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:20:40.661177 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-1770270e-9eda-4916-8f0b-d8f59254b4e6 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 200 len: 1440 microversion: 2.1 time: 0.156279 Sep 06 01:20:40.661735 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 545/1054] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:20:40 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 1440 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:20:40.686427 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a0c80ca6-fb31-4768-b255-7c966803f8e7 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:20:40.687041 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a0c80ca6-fb31-4768-b255-7c966803f8e7 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:20:40.693493 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a0c80ca6-fb31-4768-b255-7c966803f8e7 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:20:40.693979 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a0c80ca6-fb31-4768-b255-7c966803f8e7 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:20:40.694417 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a0c80ca6-fb31-4768-b255-7c966803f8e7 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:20:40.695107 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a0c80ca6-fb31-4768-b255-7c966803f8e7 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:20:40.695567 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a0c80ca6-fb31-4768-b255-7c966803f8e7 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:20:40.696016 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a0c80ca6-fb31-4768-b255-7c966803f8e7 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:20:40.823540 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-a0c80ca6-fb31-4768-b255-7c966803f8e7 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258826592903462eb4a9274e96589bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa07fc2740842a98113dcae8f46cc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:20:40.831673 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a0c80ca6-fb31-4768-b255-7c966803f8e7 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 200 len: 1440 microversion: 2.1 time: 0.149077 Sep 06 01:20:40.832258 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 510/1055] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:20:40 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 1440 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:20:42.464040 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-2cf87782-3670-426c-adb1-a974a5874bff req-e7064a48-0127-469f-a35d-6eccfd8d9fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c92d824-4c34-47bb-8f1a-237fbc1da8db", "tag": "e66b5c8c-3f4c-4245-ba50-acda95cbc070"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:20:42.477564 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-2cf87782-3670-426c-adb1-a974a5874bff req-e7064a48-0127-469f-a35d-6eccfd8d9fa9 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:20:42.477564 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-2cf87782-3670-426c-adb1-a974a5874bff req-e7064a48-0127-469f-a35d-6eccfd8d9fa9 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:20:42.477564 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-2cf87782-3670-426c-adb1-a974a5874bff req-e7064a48-0127-469f-a35d-6eccfd8d9fa9 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:20:42.488085 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.compute.server_external_events [req-2cf87782-3670-426c-adb1-a974a5874bff req-e7064a48-0127-469f-a35d-6eccfd8d9fa9 service nova] Creating event network-changed:e66b5c8c-3f4c-4245-ba50-acda95cbc070 for instance 1c92d824-4c34-47bb-8f1a-237fbc1da8db on hv-cinder-84773 Sep 06 01:20:42.493158 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [req-2cf87782-3670-426c-adb1-a974a5874bff req-e7064a48-0127-469f-a35d-6eccfd8d9fa9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034951 Sep 06 01:20:42.493931 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 546/1056] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:22:37.523652 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=20 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:22:37.524426 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=48 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:22:37.525935 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 01:22:37.526073 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Tue Sep 6 01:22:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db/action (ip 10.222.0.23) !!! Sep 06 01:22:37.530782 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2011a91d-d5da-4b17-81e9-a474f3970164 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:22:37.531832 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2011a91d-d5da-4b17-81e9-a474f3970164 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:22:37.540201 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2011a91d-d5da-4b17-81e9-a474f3970164 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:22:37.540676 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2011a91d-d5da-4b17-81e9-a474f3970164 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:22:37.541113 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2011a91d-d5da-4b17-81e9-a474f3970164 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:22:37.541797 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2011a91d-d5da-4b17-81e9-a474f3970164 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:22:37.542251 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2011a91d-d5da-4b17-81e9-a474f3970164 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:22:37.542673 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2011a91d-d5da-4b17-81e9-a474f3970164 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:22:37.565448 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-2011a91d-d5da-4b17-81e9-a474f3970164 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lazy-loading 'flavor' on Instance uuid 1c92d824-4c34-47bb-8f1a-237fbc1da8db {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 01:22:37.636450 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2011a91d-d5da-4b17-81e9-a474f3970164 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "POST /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db/action" status: 202 len: 0 microversion: 2.1 time: 0.114289 Sep 06 01:22:37.637025 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 511/1057] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Sep 6 01:22:37 2022] POST /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 01:22:37.643635 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:22:37.644474 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell1:SELECT=44 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:22:37.645394 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 01:22:37.645596 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Tue Sep 6 01:22:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db (ip 10.222.0.23) !!! Sep 06 01:22:37.650954 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-a2d47a2b-7c70-469e-9399-f77536ac7e64 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:22:37.651670 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-a2d47a2b-7c70-469e-9399-f77536ac7e64 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:22:37.662343 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a2d47a2b-7c70-469e-9399-f77536ac7e64 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:22:37.662828 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a2d47a2b-7c70-469e-9399-f77536ac7e64 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:22:37.663513 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a2d47a2b-7c70-469e-9399-f77536ac7e64 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:22:37.664341 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a2d47a2b-7c70-469e-9399-f77536ac7e64 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:22:37.664801 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a2d47a2b-7c70-469e-9399-f77536ac7e64 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:22:37.665225 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a2d47a2b-7c70-469e-9399-f77536ac7e64 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:22:38.075032 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-a2d47a2b-7c70-469e-9399-f77536ac7e64 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258826592903462eb4a9274e96589bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa07fc2740842a98113dcae8f46cc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:22:38.083176 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-a2d47a2b-7c70-469e-9399-f77536ac7e64 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 200 len: 1565 microversion: 2.1 time: 0.441617 Sep 06 01:22:38.083736 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 547/1058] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:22:37 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 1565 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:22:39.107282 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f38a1026-e494-43f8-8fe1-9e096ea9663b tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:22:39.107962 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f38a1026-e494-43f8-8fe1-9e096ea9663b tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:22:39.114730 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f38a1026-e494-43f8-8fe1-9e096ea9663b tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:22:39.115209 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f38a1026-e494-43f8-8fe1-9e096ea9663b tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:22:39.115648 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f38a1026-e494-43f8-8fe1-9e096ea9663b tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:22:39.116351 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f38a1026-e494-43f8-8fe1-9e096ea9663b tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:22:39.116805 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f38a1026-e494-43f8-8fe1-9e096ea9663b tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:22:39.117227 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f38a1026-e494-43f8-8fe1-9e096ea9663b tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:22:39.295823 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-f38a1026-e494-43f8-8fe1-9e096ea9663b tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258826592903462eb4a9274e96589bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa07fc2740842a98113dcae8f46cc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:22:39.304061 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f38a1026-e494-43f8-8fe1-9e096ea9663b tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 200 len: 1565 microversion: 2.1 time: 0.201703 Sep 06 01:22:39.304627 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 512/1059] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:22:39 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 1565 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:22:40.325960 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-2862ae8f-cee0-4805-a15d-ab2593973949 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:22:40.326615 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-2862ae8f-cee0-4805-a15d-ab2593973949 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:22:40.333253 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2862ae8f-cee0-4805-a15d-ab2593973949 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:22:40.333736 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2862ae8f-cee0-4805-a15d-ab2593973949 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:22:40.334179 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2862ae8f-cee0-4805-a15d-ab2593973949 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:22:40.334863 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2862ae8f-cee0-4805-a15d-ab2593973949 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:22:40.335316 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2862ae8f-cee0-4805-a15d-ab2593973949 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:22:40.335740 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2862ae8f-cee0-4805-a15d-ab2593973949 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:22:40.461934 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-2862ae8f-cee0-4805-a15d-ab2593973949 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258826592903462eb4a9274e96589bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa07fc2740842a98113dcae8f46cc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:22:40.470183 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-2862ae8f-cee0-4805-a15d-ab2593973949 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 200 len: 1565 microversion: 2.1 time: 0.147441 Sep 06 01:22:40.470778 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 548/1060] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:22:40 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:22:41.495375 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cc65b3fe-bf71-4e4e-b1f2-f802912b0094 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:22:41.495946 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cc65b3fe-bf71-4e4e-b1f2-f802912b0094 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:22:41.502800 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc65b3fe-bf71-4e4e-b1f2-f802912b0094 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:22:41.503285 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc65b3fe-bf71-4e4e-b1f2-f802912b0094 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:22:41.503718 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc65b3fe-bf71-4e4e-b1f2-f802912b0094 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:22:41.504444 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc65b3fe-bf71-4e4e-b1f2-f802912b0094 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:22:41.504897 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc65b3fe-bf71-4e4e-b1f2-f802912b0094 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:22:41.505348 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc65b3fe-bf71-4e4e-b1f2-f802912b0094 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:22:41.640739 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-cc65b3fe-bf71-4e4e-b1f2-f802912b0094 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258826592903462eb4a9274e96589bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa07fc2740842a98113dcae8f46cc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:22:41.648404 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cc65b3fe-bf71-4e4e-b1f2-f802912b0094 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 200 len: 1565 microversion: 2.1 time: 0.158400 Sep 06 01:22:41.648977 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 513/1061] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:22:41 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:22:42.671952 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-4077e9dd-0ffa-49ab-a396-bef00a543f88 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:22:42.672565 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-4077e9dd-0ffa-49ab-a396-bef00a543f88 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:22:42.679141 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4077e9dd-0ffa-49ab-a396-bef00a543f88 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:22:42.679626 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4077e9dd-0ffa-49ab-a396-bef00a543f88 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:22:42.680112 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4077e9dd-0ffa-49ab-a396-bef00a543f88 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:22:42.680811 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4077e9dd-0ffa-49ab-a396-bef00a543f88 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:22:42.681269 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4077e9dd-0ffa-49ab-a396-bef00a543f88 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:22:42.681726 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4077e9dd-0ffa-49ab-a396-bef00a543f88 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:22:42.812768 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-4077e9dd-0ffa-49ab-a396-bef00a543f88 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258826592903462eb4a9274e96589bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa07fc2740842a98113dcae8f46cc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:22:42.821033 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-4077e9dd-0ffa-49ab-a396-bef00a543f88 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 200 len: 1565 microversion: 2.1 time: 0.153212 Sep 06 01:22:42.821601 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 549/1062] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:22:42 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:22:43.844842 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f1747b36-c52b-4ccf-8d1e-3b5903f2db5b tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:22:43.845373 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f1747b36-c52b-4ccf-8d1e-3b5903f2db5b tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:22:43.851643 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1747b36-c52b-4ccf-8d1e-3b5903f2db5b tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:22:43.852147 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1747b36-c52b-4ccf-8d1e-3b5903f2db5b tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:22:43.852576 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1747b36-c52b-4ccf-8d1e-3b5903f2db5b tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:22:43.853282 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1747b36-c52b-4ccf-8d1e-3b5903f2db5b tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:22:43.853731 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1747b36-c52b-4ccf-8d1e-3b5903f2db5b tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:22:43.854146 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1747b36-c52b-4ccf-8d1e-3b5903f2db5b tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:22:43.980483 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-f1747b36-c52b-4ccf-8d1e-3b5903f2db5b tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258826592903462eb4a9274e96589bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa07fc2740842a98113dcae8f46cc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:22:43.988488 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f1747b36-c52b-4ccf-8d1e-3b5903f2db5b tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 200 len: 1565 microversion: 2.1 time: 0.147596 Sep 06 01:22:43.989040 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 514/1063] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:22:43 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:22:45.011802 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-bdee7f6b-916e-410f-9f3f-57e2775b354e tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:22:45.012413 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-bdee7f6b-916e-410f-9f3f-57e2775b354e tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:22:45.019389 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-bdee7f6b-916e-410f-9f3f-57e2775b354e tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:22:45.020071 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-bdee7f6b-916e-410f-9f3f-57e2775b354e tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:22:45.020515 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-bdee7f6b-916e-410f-9f3f-57e2775b354e tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:22:45.021211 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-bdee7f6b-916e-410f-9f3f-57e2775b354e tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:22:45.021669 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-bdee7f6b-916e-410f-9f3f-57e2775b354e tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:22:45.022098 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-bdee7f6b-916e-410f-9f3f-57e2775b354e tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:22:45.153035 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-bdee7f6b-916e-410f-9f3f-57e2775b354e tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258826592903462eb4a9274e96589bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa07fc2740842a98113dcae8f46cc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:22:45.160731 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-bdee7f6b-916e-410f-9f3f-57e2775b354e tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 200 len: 1565 microversion: 2.1 time: 0.152908 Sep 06 01:22:45.161294 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 550/1064] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:22:45 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:22:46.184318 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cdd18781-02c6-40bb-a026-03c5583d47ac tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:22:46.184928 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cdd18781-02c6-40bb-a026-03c5583d47ac tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:22:46.191289 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cdd18781-02c6-40bb-a026-03c5583d47ac tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:22:46.191805 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cdd18781-02c6-40bb-a026-03c5583d47ac tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:22:46.192245 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cdd18781-02c6-40bb-a026-03c5583d47ac tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:22:46.192929 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cdd18781-02c6-40bb-a026-03c5583d47ac tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:22:46.193381 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cdd18781-02c6-40bb-a026-03c5583d47ac tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:22:46.193805 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cdd18781-02c6-40bb-a026-03c5583d47ac tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:22:46.321260 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-cdd18781-02c6-40bb-a026-03c5583d47ac tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258826592903462eb4a9274e96589bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa07fc2740842a98113dcae8f46cc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:22:46.329532 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cdd18781-02c6-40bb-a026-03c5583d47ac tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 200 len: 1565 microversion: 2.1 time: 0.148470 Sep 06 01:22:46.330087 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 515/1065] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:22:46 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:22:47.352417 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-4935f715-b505-4806-998f-bd635b6c3e4d tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:22:47.353028 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-4935f715-b505-4806-998f-bd635b6c3e4d tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:22:47.359406 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4935f715-b505-4806-998f-bd635b6c3e4d tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:22:47.360525 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4935f715-b505-4806-998f-bd635b6c3e4d tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:22:47.360967 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4935f715-b505-4806-998f-bd635b6c3e4d tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:22:47.361647 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4935f715-b505-4806-998f-bd635b6c3e4d tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:22:47.362096 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4935f715-b505-4806-998f-bd635b6c3e4d tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:22:47.362513 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4935f715-b505-4806-998f-bd635b6c3e4d tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:22:47.494688 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-4935f715-b505-4806-998f-bd635b6c3e4d tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258826592903462eb4a9274e96589bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa07fc2740842a98113dcae8f46cc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:22:47.502677 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-4935f715-b505-4806-998f-bd635b6c3e4d tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 200 len: 1565 microversion: 2.1 time: 0.154054 Sep 06 01:22:47.504752 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 551/1066] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:22:47 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:22:48.528487 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cb9d0baa-c78c-48a5-862d-57f678f38f25 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:22:48.529101 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cb9d0baa-c78c-48a5-862d-57f678f38f25 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:22:48.536030 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb9d0baa-c78c-48a5-862d-57f678f38f25 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:22:48.536510 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb9d0baa-c78c-48a5-862d-57f678f38f25 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:22:48.536945 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb9d0baa-c78c-48a5-862d-57f678f38f25 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:22:48.537628 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb9d0baa-c78c-48a5-862d-57f678f38f25 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:22:48.538341 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb9d0baa-c78c-48a5-862d-57f678f38f25 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:22:48.538766 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb9d0baa-c78c-48a5-862d-57f678f38f25 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:22:48.667858 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-cb9d0baa-c78c-48a5-862d-57f678f38f25 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258826592903462eb4a9274e96589bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa07fc2740842a98113dcae8f46cc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:22:48.676111 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cb9d0baa-c78c-48a5-862d-57f678f38f25 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 200 len: 1565 microversion: 2.1 time: 0.151438 Sep 06 01:22:48.676663 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 516/1067] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:22:48 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:22:49.698429 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-e364bc93-438f-4b11-b03e-534b8ab5f86a tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:22:49.699046 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-e364bc93-438f-4b11-b03e-534b8ab5f86a tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:22:49.705600 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e364bc93-438f-4b11-b03e-534b8ab5f86a tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:22:49.706082 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e364bc93-438f-4b11-b03e-534b8ab5f86a tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:22:49.706519 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e364bc93-438f-4b11-b03e-534b8ab5f86a tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:22:49.707206 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e364bc93-438f-4b11-b03e-534b8ab5f86a tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:22:49.707659 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e364bc93-438f-4b11-b03e-534b8ab5f86a tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:22:49.708111 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e364bc93-438f-4b11-b03e-534b8ab5f86a tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:22:49.841247 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-e364bc93-438f-4b11-b03e-534b8ab5f86a tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258826592903462eb4a9274e96589bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa07fc2740842a98113dcae8f46cc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:22:49.849346 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-e364bc93-438f-4b11-b03e-534b8ab5f86a tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 200 len: 1565 microversion: 2.1 time: 0.154817 Sep 06 01:22:49.849913 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 552/1068] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:22:49 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:22:50.873120 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0830a597-0f13-483d-97c4-ae50d8b228f5 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:22:50.873659 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0830a597-0f13-483d-97c4-ae50d8b228f5 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:22:50.880137 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0830a597-0f13-483d-97c4-ae50d8b228f5 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:22:50.880625 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0830a597-0f13-483d-97c4-ae50d8b228f5 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:22:50.881063 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0830a597-0f13-483d-97c4-ae50d8b228f5 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:22:50.881752 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0830a597-0f13-483d-97c4-ae50d8b228f5 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:22:50.882211 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0830a597-0f13-483d-97c4-ae50d8b228f5 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:22:50.882637 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0830a597-0f13-483d-97c4-ae50d8b228f5 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:22:51.022006 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-0830a597-0f13-483d-97c4-ae50d8b228f5 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258826592903462eb4a9274e96589bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa07fc2740842a98113dcae8f46cc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:22:51.029597 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0830a597-0f13-483d-97c4-ae50d8b228f5 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 200 len: 1506 microversion: 2.1 time: 0.160535 Sep 06 01:22:51.030153 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 517/1069] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:22:50 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:22:51.053070 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-d45d48b9-dfb6-4733-b651-f6dd66d6b260 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:22:51.053668 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-d45d48b9-dfb6-4733-b651-f6dd66d6b260 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:22:51.060037 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d45d48b9-dfb6-4733-b651-f6dd66d6b260 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:22:51.060521 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d45d48b9-dfb6-4733-b651-f6dd66d6b260 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:22:51.060957 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d45d48b9-dfb6-4733-b651-f6dd66d6b260 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:22:51.061644 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d45d48b9-dfb6-4733-b651-f6dd66d6b260 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:22:51.062100 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d45d48b9-dfb6-4733-b651-f6dd66d6b260 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:22:51.062522 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-d45d48b9-dfb6-4733-b651-f6dd66d6b260 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:22:51.145066 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-d45d48b9-dfb6-4733-b651-f6dd66d6b260 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120580) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 06 01:22:51.211960 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-d45d48b9-dfb6-4733-b651-f6dd66d6b260 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "POST /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db/action" status: 202 len: 0 microversion: 2.1 time: 0.162409 Sep 06 01:22:51.212568 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 553/1070] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Sep 6 01:22:51 2022] POST /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 01:22:51.221085 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b685f539-b00c-403f-8695-212a9a917125 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:22:51.221719 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b685f539-b00c-403f-8695-212a9a917125 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:22:51.227619 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b685f539-b00c-403f-8695-212a9a917125 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:22:51.228197 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b685f539-b00c-403f-8695-212a9a917125 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:22:51.228627 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b685f539-b00c-403f-8695-212a9a917125 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:22:51.229308 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b685f539-b00c-403f-8695-212a9a917125 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:22:51.229757 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b685f539-b00c-403f-8695-212a9a917125 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:22:51.230174 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b685f539-b00c-403f-8695-212a9a917125 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:22:51.372366 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-b685f539-b00c-403f-8695-212a9a917125 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258826592903462eb4a9274e96589bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa07fc2740842a98113dcae8f46cc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:22:51.380022 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b685f539-b00c-403f-8695-212a9a917125 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 200 len: 1514 microversion: 2.1 time: 0.163190 Sep 06 01:22:51.380505 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 518/1071] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:22:51 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:22:52.402438 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-b7fedf8d-8cb4-4f31-92f1-ecf262b8bf6e tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:22:52.403084 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-b7fedf8d-8cb4-4f31-92f1-ecf262b8bf6e tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:22:52.410264 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b7fedf8d-8cb4-4f31-92f1-ecf262b8bf6e tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:22:52.410747 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b7fedf8d-8cb4-4f31-92f1-ecf262b8bf6e tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:22:52.411180 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b7fedf8d-8cb4-4f31-92f1-ecf262b8bf6e tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:22:52.411896 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b7fedf8d-8cb4-4f31-92f1-ecf262b8bf6e tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:22:52.412349 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b7fedf8d-8cb4-4f31-92f1-ecf262b8bf6e tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:22:52.412774 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b7fedf8d-8cb4-4f31-92f1-ecf262b8bf6e tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:22:52.541908 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-b7fedf8d-8cb4-4f31-92f1-ecf262b8bf6e tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258826592903462eb4a9274e96589bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa07fc2740842a98113dcae8f46cc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:22:52.550263 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-b7fedf8d-8cb4-4f31-92f1-ecf262b8bf6e tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 200 len: 1514 microversion: 2.1 time: 0.151819 Sep 06 01:22:52.551052 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 554/1072] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:22:52 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:22:53.573841 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-81df4dcc-1653-48be-a1ec-cfc5e066ef56 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:22:53.574481 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-81df4dcc-1653-48be-a1ec-cfc5e066ef56 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:22:53.582779 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81df4dcc-1653-48be-a1ec-cfc5e066ef56 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:22:53.582779 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81df4dcc-1653-48be-a1ec-cfc5e066ef56 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:22:53.582779 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81df4dcc-1653-48be-a1ec-cfc5e066ef56 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:22:53.582779 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81df4dcc-1653-48be-a1ec-cfc5e066ef56 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:22:53.583204 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81df4dcc-1653-48be-a1ec-cfc5e066ef56 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:22:53.583204 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81df4dcc-1653-48be-a1ec-cfc5e066ef56 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:22:53.727553 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-81df4dcc-1653-48be-a1ec-cfc5e066ef56 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258826592903462eb4a9274e96589bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa07fc2740842a98113dcae8f46cc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:22:53.742195 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-81df4dcc-1653-48be-a1ec-cfc5e066ef56 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 200 len: 1514 microversion: 2.1 time: 0.172369 Sep 06 01:22:53.744479 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 519/1073] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:22:53 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:22:53.804216 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-2810d82b-aa57-4c47-a757-21c2ddcd683b req-175a013c-49a4-4bc8-a009-07c52ee644c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c92d824-4c34-47bb-8f1a-237fbc1da8db", "name": "network-vif-unplugged", "status": "completed", "tag": "e66b5c8c-3f4c-4245-ba50-acda95cbc070"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:22:53.814555 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-2810d82b-aa57-4c47-a757-21c2ddcd683b req-175a013c-49a4-4bc8-a009-07c52ee644c8 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:22:53.815100 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-2810d82b-aa57-4c47-a757-21c2ddcd683b req-175a013c-49a4-4bc8-a009-07c52ee644c8 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:22:53.815630 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-2810d82b-aa57-4c47-a757-21c2ddcd683b req-175a013c-49a4-4bc8-a009-07c52ee644c8 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:22:53.826727 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.compute.server_external_events [req-2810d82b-aa57-4c47-a757-21c2ddcd683b req-175a013c-49a4-4bc8-a009-07c52ee644c8 service nova] Unable to find a host for instance 1c92d824-4c34-47bb-8f1a-237fbc1da8db. Dropping event network-vif-unplugged {{(pid=120580) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 06 01:22:53.827528 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [req-2810d82b-aa57-4c47-a757-21c2ddcd683b req-175a013c-49a4-4bc8-a009-07c52ee644c8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.091876 Sep 06 01:22:53.828135 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 555/1074] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 94 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 06 01:22:54.765845 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-957b5768-c2a0-430e-a3c6-6693f70f1b15 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:22:54.767091 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-957b5768-c2a0-430e-a3c6-6693f70f1b15 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:22:54.773473 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-957b5768-c2a0-430e-a3c6-6693f70f1b15 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:22:54.773950 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-957b5768-c2a0-430e-a3c6-6693f70f1b15 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:22:54.774381 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-957b5768-c2a0-430e-a3c6-6693f70f1b15 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:22:54.775061 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-957b5768-c2a0-430e-a3c6-6693f70f1b15 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:22:54.775509 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-957b5768-c2a0-430e-a3c6-6693f70f1b15 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:22:54.775954 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-957b5768-c2a0-430e-a3c6-6693f70f1b15 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:22:54.901362 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-957b5768-c2a0-430e-a3c6-6693f70f1b15 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258826592903462eb4a9274e96589bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa07fc2740842a98113dcae8f46cc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:22:54.909194 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-957b5768-c2a0-430e-a3c6-6693f70f1b15 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 200 len: 1514 microversion: 2.1 time: 0.146937 Sep 06 01:22:54.909755 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 520/1075] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:22:54 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:22:55.933031 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-4460cbc0-e162-4a1d-a2f3-60b60f8d0e7d tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:22:55.933651 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-4460cbc0-e162-4a1d-a2f3-60b60f8d0e7d tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:22:55.940469 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4460cbc0-e162-4a1d-a2f3-60b60f8d0e7d tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:22:55.940941 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4460cbc0-e162-4a1d-a2f3-60b60f8d0e7d tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:22:55.941390 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4460cbc0-e162-4a1d-a2f3-60b60f8d0e7d tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:22:55.942079 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4460cbc0-e162-4a1d-a2f3-60b60f8d0e7d tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:22:55.944879 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4460cbc0-e162-4a1d-a2f3-60b60f8d0e7d tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:22:55.945322 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4460cbc0-e162-4a1d-a2f3-60b60f8d0e7d tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:22:56.079873 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-4460cbc0-e162-4a1d-a2f3-60b60f8d0e7d tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258826592903462eb4a9274e96589bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa07fc2740842a98113dcae8f46cc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:22:56.087474 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-4460cbc0-e162-4a1d-a2f3-60b60f8d0e7d tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 200 len: 1516 microversion: 2.1 time: 0.158519 Sep 06 01:22:56.088062 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 556/1076] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:22:55 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:22:57.111015 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b908e0b0-7464-4d2b-9c96-b7ab5e9a4282 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:22:57.111623 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b908e0b0-7464-4d2b-9c96-b7ab5e9a4282 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:22:57.118131 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b908e0b0-7464-4d2b-9c96-b7ab5e9a4282 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:22:57.118610 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b908e0b0-7464-4d2b-9c96-b7ab5e9a4282 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:22:57.119039 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b908e0b0-7464-4d2b-9c96-b7ab5e9a4282 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:22:57.119721 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b908e0b0-7464-4d2b-9c96-b7ab5e9a4282 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:22:57.120195 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b908e0b0-7464-4d2b-9c96-b7ab5e9a4282 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:22:57.120612 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b908e0b0-7464-4d2b-9c96-b7ab5e9a4282 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:22:57.258532 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-b908e0b0-7464-4d2b-9c96-b7ab5e9a4282 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258826592903462eb4a9274e96589bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa07fc2740842a98113dcae8f46cc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:22:57.267011 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b908e0b0-7464-4d2b-9c96-b7ab5e9a4282 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 200 len: 1572 microversion: 2.1 time: 0.160394 Sep 06 01:22:57.275663 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 521/1077] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:22:57 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 1572 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:22:58.292169 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-c6430d0a-8bee-4299-bd56-9ecc7361f420 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:22:58.292785 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-c6430d0a-8bee-4299-bd56-9ecc7361f420 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:22:58.299953 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c6430d0a-8bee-4299-bd56-9ecc7361f420 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:22:58.300436 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c6430d0a-8bee-4299-bd56-9ecc7361f420 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:22:58.300871 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c6430d0a-8bee-4299-bd56-9ecc7361f420 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:22:58.301558 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c6430d0a-8bee-4299-bd56-9ecc7361f420 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:22:58.302009 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c6430d0a-8bee-4299-bd56-9ecc7361f420 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:22:58.302430 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c6430d0a-8bee-4299-bd56-9ecc7361f420 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:22:58.429399 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-c6430d0a-8bee-4299-bd56-9ecc7361f420 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258826592903462eb4a9274e96589bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa07fc2740842a98113dcae8f46cc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:22:58.437042 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-c6430d0a-8bee-4299-bd56-9ecc7361f420 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 200 len: 1572 microversion: 2.1 time: 0.149200 Sep 06 01:22:58.437602 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 557/1078] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:22:58 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 1572 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:22:59.459987 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fef7ee8f-61ac-4863-aee6-ddbec7cb6876 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:22:59.460600 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fef7ee8f-61ac-4863-aee6-ddbec7cb6876 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:22:59.467028 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fef7ee8f-61ac-4863-aee6-ddbec7cb6876 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:22:59.467509 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fef7ee8f-61ac-4863-aee6-ddbec7cb6876 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:22:59.467987 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fef7ee8f-61ac-4863-aee6-ddbec7cb6876 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:22:59.468684 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fef7ee8f-61ac-4863-aee6-ddbec7cb6876 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:22:59.469331 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fef7ee8f-61ac-4863-aee6-ddbec7cb6876 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:22:59.469757 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fef7ee8f-61ac-4863-aee6-ddbec7cb6876 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:22:59.602816 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-fef7ee8f-61ac-4863-aee6-ddbec7cb6876 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258826592903462eb4a9274e96589bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa07fc2740842a98113dcae8f46cc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:22:59.610977 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fef7ee8f-61ac-4863-aee6-ddbec7cb6876 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 200 len: 1572 microversion: 2.1 time: 0.154969 Sep 06 01:22:59.611540 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 522/1079] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:22:59 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 1572 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:23:00.634998 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-86ea34fc-2fad-4e01-95a2-dc1220e4bb2f tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:23:00.635604 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-86ea34fc-2fad-4e01-95a2-dc1220e4bb2f tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:23:00.642741 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-86ea34fc-2fad-4e01-95a2-dc1220e4bb2f tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:23:00.643212 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-86ea34fc-2fad-4e01-95a2-dc1220e4bb2f tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:23:00.643642 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-86ea34fc-2fad-4e01-95a2-dc1220e4bb2f tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:23:00.644359 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-86ea34fc-2fad-4e01-95a2-dc1220e4bb2f tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:23:00.644807 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-86ea34fc-2fad-4e01-95a2-dc1220e4bb2f tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:23:00.645225 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-86ea34fc-2fad-4e01-95a2-dc1220e4bb2f tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:23:00.772485 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-86ea34fc-2fad-4e01-95a2-dc1220e4bb2f tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258826592903462eb4a9274e96589bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa07fc2740842a98113dcae8f46cc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:23:00.780052 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-86ea34fc-2fad-4e01-95a2-dc1220e4bb2f tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 200 len: 1572 microversion: 2.1 time: 0.148902 Sep 06 01:23:00.780606 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 558/1080] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:23:00 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 1572 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:23:01.802952 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-eb2669ca-ade0-49c6-8698-54e44ef397aa tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:23:01.803569 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-eb2669ca-ade0-49c6-8698-54e44ef397aa tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:23:01.809820 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb2669ca-ade0-49c6-8698-54e44ef397aa tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:23:01.810300 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb2669ca-ade0-49c6-8698-54e44ef397aa tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:23:01.810732 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb2669ca-ade0-49c6-8698-54e44ef397aa tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:23:01.811412 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb2669ca-ade0-49c6-8698-54e44ef397aa tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:23:01.811893 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb2669ca-ade0-49c6-8698-54e44ef397aa tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:23:01.812318 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb2669ca-ade0-49c6-8698-54e44ef397aa tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:23:01.945048 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-eb2669ca-ade0-49c6-8698-54e44ef397aa tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258826592903462eb4a9274e96589bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa07fc2740842a98113dcae8f46cc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:23:01.952732 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-eb2669ca-ade0-49c6-8698-54e44ef397aa tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 200 len: 1572 microversion: 2.1 time: 0.153657 Sep 06 01:23:01.953807 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 523/1081] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:23:01 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 1572 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:23:02.981029 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-7169550b-43d1-4c28-8b0e-fe0994c08741 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:23:02.981642 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-7169550b-43d1-4c28-8b0e-fe0994c08741 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:23:02.988792 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7169550b-43d1-4c28-8b0e-fe0994c08741 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:23:02.989271 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7169550b-43d1-4c28-8b0e-fe0994c08741 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:23:02.989703 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7169550b-43d1-4c28-8b0e-fe0994c08741 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:23:02.990385 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7169550b-43d1-4c28-8b0e-fe0994c08741 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:23:02.990836 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7169550b-43d1-4c28-8b0e-fe0994c08741 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:23:02.991258 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7169550b-43d1-4c28-8b0e-fe0994c08741 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:23:03.118485 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-7169550b-43d1-4c28-8b0e-fe0994c08741 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258826592903462eb4a9274e96589bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa07fc2740842a98113dcae8f46cc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:23:03.126090 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-7169550b-43d1-4c28-8b0e-fe0994c08741 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 200 len: 1572 microversion: 2.1 time: 0.148995 Sep 06 01:23:03.126645 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 559/1082] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:23:02 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 1572 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:23:04.148824 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-50964e83-78fa-45c4-a391-f0c7c49db907 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:23:04.149431 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-50964e83-78fa-45c4-a391-f0c7c49db907 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:23:04.155783 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50964e83-78fa-45c4-a391-f0c7c49db907 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:23:04.156276 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50964e83-78fa-45c4-a391-f0c7c49db907 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:23:04.156703 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50964e83-78fa-45c4-a391-f0c7c49db907 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:23:04.157380 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50964e83-78fa-45c4-a391-f0c7c49db907 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:23:04.157827 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50964e83-78fa-45c4-a391-f0c7c49db907 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:23:04.158243 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50964e83-78fa-45c4-a391-f0c7c49db907 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:23:04.290113 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-50964e83-78fa-45c4-a391-f0c7c49db907 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258826592903462eb4a9274e96589bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa07fc2740842a98113dcae8f46cc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:23:04.298251 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-50964e83-78fa-45c4-a391-f0c7c49db907 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 200 len: 1572 microversion: 2.1 time: 0.153271 Sep 06 01:23:04.298818 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 524/1083] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:23:04 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 1572 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:23:05.321630 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-7b4a6913-f694-4d8a-86b1-cf833c782770 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:23:05.322245 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-7b4a6913-f694-4d8a-86b1-cf833c782770 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:23:05.329309 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7b4a6913-f694-4d8a-86b1-cf833c782770 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:23:05.329786 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7b4a6913-f694-4d8a-86b1-cf833c782770 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:23:05.330218 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7b4a6913-f694-4d8a-86b1-cf833c782770 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:23:05.330904 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7b4a6913-f694-4d8a-86b1-cf833c782770 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:23:05.331360 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7b4a6913-f694-4d8a-86b1-cf833c782770 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:23:05.331810 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7b4a6913-f694-4d8a-86b1-cf833c782770 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:23:05.461959 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-7b4a6913-f694-4d8a-86b1-cf833c782770 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258826592903462eb4a9274e96589bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa07fc2740842a98113dcae8f46cc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:23:05.469793 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-7b4a6913-f694-4d8a-86b1-cf833c782770 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 200 len: 1572 microversion: 2.1 time: 0.152004 Sep 06 01:23:05.470353 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 560/1084] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:23:05 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 1572 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:23:05.828370 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-c44ed88d-5ac5-493c-bba2-5fce062f65ec req-2fcf4868-2255-4182-be51-2e9f1420cd22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c92d824-4c34-47bb-8f1a-237fbc1da8db", "name": "network-vif-plugged", "status": "completed", "tag": "e66b5c8c-3f4c-4245-ba50-acda95cbc070"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:23:05.840032 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c44ed88d-5ac5-493c-bba2-5fce062f65ec req-2fcf4868-2255-4182-be51-2e9f1420cd22 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:23:05.840643 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c44ed88d-5ac5-493c-bba2-5fce062f65ec req-2fcf4868-2255-4182-be51-2e9f1420cd22 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:23:05.841089 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c44ed88d-5ac5-493c-bba2-5fce062f65ec req-2fcf4868-2255-4182-be51-2e9f1420cd22 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:23:05.853125 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-c44ed88d-5ac5-493c-bba2-5fce062f65ec req-2fcf4868-2255-4182-be51-2e9f1420cd22 service nova] Creating event network-vif-plugged:e66b5c8c-3f4c-4245-ba50-acda95cbc070 for instance 1c92d824-4c34-47bb-8f1a-237fbc1da8db on hv-cinder-84773 Sep 06 01:23:05.858189 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-c44ed88d-5ac5-493c-bba2-5fce062f65ec req-2fcf4868-2255-4182-be51-2e9f1420cd22 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033539 Sep 06 01:23:05.858987 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 525/1085] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:23:06.493210 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-7f3594da-c48b-4515-ad0d-c48c38e21dfc tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:23:06.493817 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-7f3594da-c48b-4515-ad0d-c48c38e21dfc tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:23:06.500290 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7f3594da-c48b-4515-ad0d-c48c38e21dfc tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:23:06.500765 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7f3594da-c48b-4515-ad0d-c48c38e21dfc tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:23:06.501195 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7f3594da-c48b-4515-ad0d-c48c38e21dfc tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:23:06.501874 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7f3594da-c48b-4515-ad0d-c48c38e21dfc tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:23:06.502320 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7f3594da-c48b-4515-ad0d-c48c38e21dfc tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:23:06.502738 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7f3594da-c48b-4515-ad0d-c48c38e21dfc tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:23:06.634305 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-7f3594da-c48b-4515-ad0d-c48c38e21dfc tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258826592903462eb4a9274e96589bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa07fc2740842a98113dcae8f46cc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:23:06.642566 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-7f3594da-c48b-4515-ad0d-c48c38e21dfc tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 200 len: 1572 microversion: 2.1 time: 0.153240 Sep 06 01:23:06.643122 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 561/1086] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:23:06 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 1572 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:23:07.666371 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e7a758b6-94f2-44d1-9c5c-1d480325c198 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:23:07.667064 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e7a758b6-94f2-44d1-9c5c-1d480325c198 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:23:07.669478 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=31 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:23:07.675340 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7a758b6-94f2-44d1-9c5c-1d480325c198 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:23:07.675862 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7a758b6-94f2-44d1-9c5c-1d480325c198 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:23:07.676297 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7a758b6-94f2-44d1-9c5c-1d480325c198 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:23:07.677003 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7a758b6-94f2-44d1-9c5c-1d480325c198 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:23:07.677451 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7a758b6-94f2-44d1-9c5c-1d480325c198 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:23:07.677868 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7a758b6-94f2-44d1-9c5c-1d480325c198 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:23:07.680577 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:23:07.810393 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-e7a758b6-94f2-44d1-9c5c-1d480325c198 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258826592903462eb4a9274e96589bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa07fc2740842a98113dcae8f46cc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:23:07.818110 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e7a758b6-94f2-44d1-9c5c-1d480325c198 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 200 len: 1559 microversion: 2.1 time: 0.156211 Sep 06 01:23:07.818678 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 526/1087] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:23:07 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:24:20.962289 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:24:20.965807 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:24:20.967030 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=5 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:24:20.967424 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:24:20.968642 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 01:24:20.969439 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 01:24:20.969690 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Tue Sep 6 01:24:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.23) !!! Sep 06 01:24:20.970109 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Tue Sep 6 01:24:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db (ip 10.222.0.23) !!! Sep 06 01:24:20.972786 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 01:24:20.972905 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Tue Sep 6 01:24:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.23) !!! Sep 06 01:24:20.978137 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-da4eb9d5-5029-42e0-a0c2-958eed34bbc0 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:24:20.978635 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-da4eb9d5-5029-42e0-a0c2-958eed34bbc0 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:24:20.998822 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-da4eb9d5-5029-42e0-a0c2-958eed34bbc0 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:24:20.999338 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-da4eb9d5-5029-42e0-a0c2-958eed34bbc0 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:24:20.999798 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-da4eb9d5-5029-42e0-a0c2-958eed34bbc0 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:24:21.000568 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-da4eb9d5-5029-42e0-a0c2-958eed34bbc0 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:24:21.001020 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-da4eb9d5-5029-42e0-a0c2-958eed34bbc0 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:24:21.001494 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-da4eb9d5-5029-42e0-a0c2-958eed34bbc0 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:24:21.028716 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-da4eb9d5-5029-42e0-a0c2-958eed34bbc0 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Going to try to terminate instance {{(pid=120580) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 01:24:21.045851 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-9158ed86-5338-4344-97de-9652658ede7f req-1399131e-15d7-4b9e-b8f2-42552fc25d82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c92d824-4c34-47bb-8f1a-237fbc1da8db", "tag": "e66b5c8c-3f4c-4245-ba50-acda95cbc070"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:24:21.055231 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9158ed86-5338-4344-97de-9652658ede7f req-1399131e-15d7-4b9e-b8f2-42552fc25d82 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:24:21.055719 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9158ed86-5338-4344-97de-9652658ede7f req-1399131e-15d7-4b9e-b8f2-42552fc25d82 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:24:21.056168 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9158ed86-5338-4344-97de-9652658ede7f req-1399131e-15d7-4b9e-b8f2-42552fc25d82 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:24:21.068091 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-9158ed86-5338-4344-97de-9652658ede7f req-1399131e-15d7-4b9e-b8f2-42552fc25d82 service nova] Creating event network-changed:e66b5c8c-3f4c-4245-ba50-acda95cbc070 for instance 1c92d824-4c34-47bb-8f1a-237fbc1da8db on hv-cinder-84773 Sep 06 01:24:21.073193 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-9158ed86-5338-4344-97de-9652658ede7f req-1399131e-15d7-4b9e-b8f2-42552fc25d82 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108972 Sep 06 01:24:21.074182 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 527/1088] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 01:24:21.110269 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-da4eb9d5-5029-42e0-a0c2-958eed34bbc0 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 204 len: 0 microversion: 2.1 time: 0.149815 Sep 06 01:24:21.111514 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 562/1089] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 6 01:24:20 2022] DELETE /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 01:24:21.121117 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1372ee15-f81a-4809-9d32-499e2cc95f96 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:24:21.122187 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1372ee15-f81a-4809-9d32-499e2cc95f96 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:24:21.129647 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1372ee15-f81a-4809-9d32-499e2cc95f96 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:24:21.130431 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1372ee15-f81a-4809-9d32-499e2cc95f96 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:24:21.131114 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1372ee15-f81a-4809-9d32-499e2cc95f96 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:24:21.132082 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1372ee15-f81a-4809-9d32-499e2cc95f96 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:24:21.132797 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1372ee15-f81a-4809-9d32-499e2cc95f96 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:24:21.133456 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1372ee15-f81a-4809-9d32-499e2cc95f96 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:24:21.280570 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-1372ee15-f81a-4809-9d32-499e2cc95f96 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258826592903462eb4a9274e96589bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa07fc2740842a98113dcae8f46cc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:24:21.288444 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1372ee15-f81a-4809-9d32-499e2cc95f96 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 200 len: 1565 microversion: 2.1 time: 0.172513 Sep 06 01:24:21.289344 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 528/1090] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:24:21 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 1565 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:24:22.312495 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-90bb473e-fb90-4198-b600-3137c6fdc8c1 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:24:22.313225 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-90bb473e-fb90-4198-b600-3137c6fdc8c1 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:24:22.319616 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-90bb473e-fb90-4198-b600-3137c6fdc8c1 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:24:22.320126 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-90bb473e-fb90-4198-b600-3137c6fdc8c1 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:24:22.320560 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-90bb473e-fb90-4198-b600-3137c6fdc8c1 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:24:22.321250 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-90bb473e-fb90-4198-b600-3137c6fdc8c1 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:24:22.321697 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-90bb473e-fb90-4198-b600-3137c6fdc8c1 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:24:22.322118 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-90bb473e-fb90-4198-b600-3137c6fdc8c1 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:24:22.460179 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-90bb473e-fb90-4198-b600-3137c6fdc8c1 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258826592903462eb4a9274e96589bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa07fc2740842a98113dcae8f46cc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:24:22.468368 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-90bb473e-fb90-4198-b600-3137c6fdc8c1 tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 200 len: 1565 microversion: 2.1 time: 0.160115 Sep 06 01:24:22.468922 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 563/1091] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:24:22 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:24:23.490389 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-0d1afb7d-b694-4c34-b8ea-fd2372ee6a6c tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:24:23.490989 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-0d1afb7d-b694-4c34-b8ea-fd2372ee6a6c tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:24:23.498230 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0d1afb7d-b694-4c34-b8ea-fd2372ee6a6c tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:24:23.498721 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0d1afb7d-b694-4c34-b8ea-fd2372ee6a6c tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:24:23.499162 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0d1afb7d-b694-4c34-b8ea-fd2372ee6a6c tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:24:23.499897 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0d1afb7d-b694-4c34-b8ea-fd2372ee6a6c tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:24:23.500351 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0d1afb7d-b694-4c34-b8ea-fd2372ee6a6c tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:24:23.500765 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0d1afb7d-b694-4c34-b8ea-fd2372ee6a6c tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:24:23.510115 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-0390ee44-c987-485c-ac93-2ee138c2467b req-2875e1c2-a22c-4387-b331-3d9ea2672d63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c92d824-4c34-47bb-8f1a-237fbc1da8db", "name": "network-vif-deleted", "tag": "e66b5c8c-3f4c-4245-ba50-acda95cbc070"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:24:23.523158 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-0390ee44-c987-485c-ac93-2ee138c2467b req-2875e1c2-a22c-4387-b331-3d9ea2672d63 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:24:23.530248 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-0390ee44-c987-485c-ac93-2ee138c2467b req-2875e1c2-a22c-4387-b331-3d9ea2672d63 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:24:23.530904 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-0390ee44-c987-485c-ac93-2ee138c2467b req-2875e1c2-a22c-4387-b331-3d9ea2672d63 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:24:23.545147 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-0390ee44-c987-485c-ac93-2ee138c2467b req-2875e1c2-a22c-4387-b331-3d9ea2672d63 service nova] Creating event network-vif-deleted:e66b5c8c-3f4c-4245-ba50-acda95cbc070 for instance 1c92d824-4c34-47bb-8f1a-237fbc1da8db on hv-cinder-84773 Sep 06 01:24:23.550448 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-0390ee44-c987-485c-ac93-2ee138c2467b req-2875e1c2-a22c-4387-b331-3d9ea2672d63 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107687 Sep 06 01:24:23.551296 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 529/1092] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:24:23.567539 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-0d1afb7d-b694-4c34-b8ea-fd2372ee6a6c tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258826592903462eb4a9274e96589bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa07fc2740842a98113dcae8f46cc7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:24:23.575884 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-0d1afb7d-b694-4c34-b8ea-fd2372ee6a6c tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 200 len: 1217 microversion: 2.1 time: 0.089294 Sep 06 01:24:23.576626 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 564/1093] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:24:23 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:24:24.599468 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0eeab417-2bdf-4ab7-b893-f5f1f60c256a tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:24:24.600176 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0eeab417-2bdf-4ab7-b893-f5f1f60c256a tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] [instance: 1c92d824-4c34-47bb-8f1a-237fbc1da8db] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:24:24.606216 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0eeab417-2bdf-4ab7-b893-f5f1f60c256a tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:24:24.606675 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0eeab417-2bdf-4ab7-b893-f5f1f60c256a tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:24:24.607101 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0eeab417-2bdf-4ab7-b893-f5f1f60c256a tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:24:24.608300 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0eeab417-2bdf-4ab7-b893-f5f1f60c256a tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:24:24.608750 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0eeab417-2bdf-4ab7-b893-f5f1f60c256a tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:24:24.609163 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0eeab417-2bdf-4ab7-b893-f5f1f60c256a tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:24:24.622397 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-0eeab417-2bdf-4ab7-b893-f5f1f60c256a tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] HTTP exception thrown: Instance 1c92d824-4c34-47bb-8f1a-237fbc1da8db could not be found. Sep 06 01:24:24.624633 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0eeab417-2bdf-4ab7-b893-f5f1f60c256a tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Request method failure captured: Sep 06 01:24:24.624633 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db HTTP/1.1 Sep 06 01:24:24.624633 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept: application/json Sep 06 01:24:24.624633 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept-Encoding: identity Sep 06 01:24:24.624633 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Connection: close Sep 06 01:24:24.624633 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Length: 0 Sep 06 01:24:24.624633 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Type: application/json Sep 06 01:24:24.624633 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Host: 10.222.0.23 Sep 06 01:24:24.624633 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Openstack-System-Scope: None Sep 06 01:24:24.624633 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Sep 06 01:24:24.624633 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjFqBEkpguBzv4H16gbgmzOmnBhsfxE5m_BjZEq_W-mu_RH8cinSeLWajz789iAi8OsAlHfoMydQdwKT7kpZMifCXRE_YKsT6lHorzgo0KiUdYh4qW81GcayksWvzYO5Kio-88BfzqpdYeRRvh4PrKUEe7QWds0_l1WJPxLgSNzgpzFpU Sep 06 01:24:24.624633 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Id: None Sep 06 01:24:24.624633 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Name: None Sep 06 01:24:24.624633 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Identity-Status: Confirmed Sep 06 01:24:24.624633 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Is-Admin-Project: True Sep 06 01:24:24.624633 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Id: default Sep 06 01:24:24.624633 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Name: Default Sep 06 01:24:24.624633 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Id: dfa07fc2740842a98113dcae8f46cc7c Sep 06 01:24:24.624633 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Name: tempest-TestShelveInstance-1618228778 Sep 06 01:24:24.624633 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Role: reader,member Sep 06 01:24:24.624633 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Roles: reader,member Sep 06 01:24:24.626313 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dfa07fc2740842a98113dcae8f46cc7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dfa07fc2740842a98113dcae8f46cc7c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dfa07fc2740842a98113dcae8f46cc7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dfa07fc2740842a98113dcae8f46cc7c"}]}] Sep 06 01:24:24.626313 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant: tempest-TestShelveInstance-1618228778 Sep 06 01:24:24.626313 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Id: dfa07fc2740842a98113dcae8f46cc7c Sep 06 01:24:24.626313 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Name: tempest-TestShelveInstance-1618228778 Sep 06 01:24:24.626313 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User: tempest-TestShelveInstance-1618228778-project Sep 06 01:24:24.626313 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Id: default Sep 06 01:24:24.626313 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Name: Default Sep 06 01:24:24.626313 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Id: 258826592903462eb4a9274e96589bc9 Sep 06 01:24:24.626313 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Name: tempest-TestShelveInstance-1618228778-project Sep 06 01:24:24.626313 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: method: > Sep 06 01:24:24.626313 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: exception: Instance 1c92d824-4c34-47bb-8f1a-237fbc1da8db could not be found. Sep 06 01:24:24.626313 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: action_args: {'id': '1c92d824-4c34-47bb-8f1a-237fbc1da8db'} Sep 06 01:24:24.627276 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:24:24.627276 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:24:24.627276 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 01:24:24.627276 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 01:24:24.627276 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 01:24:24.627276 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 01:24:24.627276 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 01:24:24.627276 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 01:24:24.627276 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 01:24:24.627276 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 01:24:24.627276 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c92d824-4c34-47bb-8f1a-237fbc1da8db could not be found. Sep 06 01:24:24.627276 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:24:24.627276 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:24:24.627276 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:24:24.627276 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:24:24.627276 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:24:24.627276 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:24:24.627276 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:24:24.627276 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:24:24.627276 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:24:24.628848 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:24:24.628848 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 01:24:24.628848 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 01:24:24.628848 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 01:24:24.628848 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 01:24:24.628848 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 01:24:24.628848 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:24:24.628848 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c92d824-4c34-47bb-8f1a-237fbc1da8db could not be found. Sep 06 01:24:24.628848 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:24:24.628848 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:24:24.628848 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:24:24.628848 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:24:24.628848 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:24:24.628848 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:24:24.628848 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:24:24.628848 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:24:24.628848 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c92d824-4c34-47bb-8f1a-237fbc1da8db could not be found. Sep 06 01:24:24.628848 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:24:24.630241 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0eeab417-2bdf-4ab7-b893-f5f1f60c256a tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Returning 404 to user: Instance 1c92d824-4c34-47bb-8f1a-237fbc1da8db could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:24:24.630241 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0eeab417-2bdf-4ab7-b893-f5f1f60c256a tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db" status: 404 len: 111 microversion: 2.1 time: 0.031322 Sep 06 01:24:24.630241 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 530/1094] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:24:24 2022] GET /compute/v2.1/servers/1c92d824-4c34-47bb-8f1a-237fbc1da8db => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 01:24:24.781508 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-31a5ef93-5ad3-4316-aca1-8a5a3c5b4c5a tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] Calling method '.version_select at 0x7fb06e21f9d0>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:24:24.810069 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-31a5ef93-5ad3-4316-aca1-8a5a3c5b4c5a tempest-TestShelveInstance-1618228778 tempest-TestShelveInstance-1618228778-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-832861560" status: 202 len: 0 microversion: 2.1 time: 0.032403 Sep 06 01:24:24.810798 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 565/1095] 10.222.0.23 () {58 vars in 1251 bytes} [Tue Sep 6 01:24:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-832861560 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 01:24:41.439491 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=8 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:24:41.440213 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=12 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:24:41.617175 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-774a1381-87d4-454d-b82d-dca4442f14ce tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Action: 'create', calling method: .version_select at 0x7fb06e34ca60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-635459421", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEI4CTlOujkMLhxlVX/LOJk/j0FZ3AbrZ2PTipG2+NgiH81BLdK1oCFsji+hWzMx3I/5NQQb6TRukXK58saeirxRfQK/oIQTP9z/uIXdwkF6VPHCd7GFxiqVGnblxGcpA=="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:24:41.632948 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.quota [None req-774a1381-87d4-454d-b82d-dca4442f14ce tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Getting quotas for project 333491050689469789d7fd61b4d70cf8. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 01:24:41.636730 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.quota [None req-774a1381-87d4-454d-b82d-dca4442f14ce tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Getting quotas for user e58ada13a75445df97d8b6d1e3ea9c50 and project 333491050689469789d7fd61b4d70cf8. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 01:24:41.663051 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-774a1381-87d4-454d-b82d-dca4442f14ce tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.230614 Sep 06 01:24:41.663652 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 531/1096] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Sep 6 01:24:41 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:24:56.848248 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:24:56.849671 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:24:56.853595 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-71278ad9-7b63-4397-b868-49cadf194b52 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-335303110", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-635459421", "security_groups": [{"name": "tempest-secgroup-smoke-1916685125"}], "block_device_mapping_v2": [{"uuid": "f38ae399-7281-4a8d-a046-fb3fb10405a9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d895c0aa-bda4-4613-b99a-7874b7d4b4f0"}]}} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:24:56.966064 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.network.neutron [None req-71278ad9-7b63-4397-b868-49cadf194b52 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] validate_networks() for [('d895c0aa-bda4-4613-b99a-7874b7d4b4f0', None, None, None, None, None)] {{(pid=120580) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 01:24:57.335185 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-71278ad9-7b63-4397-b868-49cadf194b52 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Flavor limits 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 01:24:57.335608 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-71278ad9-7b63-4397-b868-49cadf194b52 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Image limits 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 01:24:57.336102 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-71278ad9-7b63-4397-b868-49cadf194b52 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Flavor pref 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 01:24:57.336509 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-71278ad9-7b63-4397-b868-49cadf194b52 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Image pref 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 01:24:57.336916 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-71278ad9-7b63-4397-b868-49cadf194b52 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 01:24:57.345951 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-71278ad9-7b63-4397-b868-49cadf194b52 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:24:57.346435 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-71278ad9-7b63-4397-b868-49cadf194b52 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:24:57.346870 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-71278ad9-7b63-4397-b868-49cadf194b52 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:24:57.347597 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-71278ad9-7b63-4397-b868-49cadf194b52 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:24:57.348076 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-71278ad9-7b63-4397-b868-49cadf194b52 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:24:57.348551 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-71278ad9-7b63-4397-b868-49cadf194b52 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:24:57.365991 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.quota [None req-71278ad9-7b63-4397-b868-49cadf194b52 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Getting quotas for project 333491050689469789d7fd61b4d70cf8. Resources: {'instances', 'ram', 'cores'} {{(pid=120580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 01:24:57.369890 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.quota [None req-71278ad9-7b63-4397-b868-49cadf194b52 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Getting quotas for user e58ada13a75445df97d8b6d1e3ea9c50 and project 333491050689469789d7fd61b4d70cf8. Resources: {'instances', 'ram', 'cores'} {{(pid=120580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 01:24:57.425242 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-71278ad9-7b63-4397-b868-49cadf194b52 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Going to run 1 instances... {{(pid=120580) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 01:24:57.427888 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-71278ad9-7b63-4397-b868-49cadf194b52 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 062259ef-5e29-4726-b12f-fde66240b80d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f38ae399-7281-4a8d-a046-fb3fb10405a9',volume_size=None,volume_type=None)] {{(pid=120580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 01:24:57.558490 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-71278ad9-7b63-4397-b868-49cadf194b52 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.711655 Sep 06 01:24:57.559202 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 566/1097] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Sep 6 01:24:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 01:24:57.567689 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=4 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:24:57.568474 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:24:57.573938 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-30cab938-53b7-4618-a7d5-0d24b0d42b80 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:24:57.575963 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-30cab938-53b7-4618-a7d5-0d24b0d42b80 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 062259ef-5e29-4726-b12f-fde66240b80d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:24:57.633903 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-30cab938-53b7-4618-a7d5-0d24b0d42b80 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:24:57.640882 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-30cab938-53b7-4618-a7d5-0d24b0d42b80 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d" status: 200 len: 1093 microversion: 2.1 time: 0.074557 Sep 06 01:24:57.645789 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 532/1098] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:24:57 2022] GET /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d => generated 1093 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:24:58.667604 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-0c6640bd-729f-49b8-be6a-01b73f0d359a tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:24:58.668628 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-0c6640bd-729f-49b8-be6a-01b73f0d359a tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 062259ef-5e29-4726-b12f-fde66240b80d] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:24:58.678795 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0c6640bd-729f-49b8-be6a-01b73f0d359a tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:24:58.679592 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0c6640bd-729f-49b8-be6a-01b73f0d359a tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:24:58.680344 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0c6640bd-729f-49b8-be6a-01b73f0d359a tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:24:58.681134 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0c6640bd-729f-49b8-be6a-01b73f0d359a tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:24:58.681653 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0c6640bd-729f-49b8-be6a-01b73f0d359a tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:24:58.682140 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-0c6640bd-729f-49b8-be6a-01b73f0d359a tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:24:58.748395 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-0c6640bd-729f-49b8-be6a-01b73f0d359a tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:24:58.756063 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-0c6640bd-729f-49b8-be6a-01b73f0d359a tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d" status: 200 len: 1209 microversion: 2.1 time: 0.096022 Sep 06 01:24:58.756628 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 567/1099] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:24:58 2022] GET /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d => generated 1209 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:24:59.778589 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-432a6324-111c-49d9-adcc-5d2b665344ae tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:24:59.779348 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-432a6324-111c-49d9-adcc-5d2b665344ae tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 062259ef-5e29-4726-b12f-fde66240b80d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:24:59.785668 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-432a6324-111c-49d9-adcc-5d2b665344ae tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:24:59.786158 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-432a6324-111c-49d9-adcc-5d2b665344ae tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:24:59.786595 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-432a6324-111c-49d9-adcc-5d2b665344ae tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:24:59.787401 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-432a6324-111c-49d9-adcc-5d2b665344ae tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:24:59.787799 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-432a6324-111c-49d9-adcc-5d2b665344ae tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:24:59.788207 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-432a6324-111c-49d9-adcc-5d2b665344ae tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:24:59.879450 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-85e6311f-da99-4144-8f24-342d8c131f6c req-1b42108e-2970-4d16-8a80-f9157a86b566 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "062259ef-5e29-4726-b12f-fde66240b80d", "tag": "c8000dc8-bc3b-4183-b93f-e81f8b5470e7"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:24:59.893548 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-85e6311f-da99-4144-8f24-342d8c131f6c req-1b42108e-2970-4d16-8a80-f9157a86b566 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:24:59.894391 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-85e6311f-da99-4144-8f24-342d8c131f6c req-1b42108e-2970-4d16-8a80-f9157a86b566 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:24:59.895214 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-85e6311f-da99-4144-8f24-342d8c131f6c req-1b42108e-2970-4d16-8a80-f9157a86b566 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:24:59.909245 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.compute.server_external_events [req-85e6311f-da99-4144-8f24-342d8c131f6c req-1b42108e-2970-4d16-8a80-f9157a86b566 service nova] Creating event network-changed:c8000dc8-bc3b-4183-b93f-e81f8b5470e7 for instance 062259ef-5e29-4726-b12f-fde66240b80d on hv-cinder-84773 Sep 06 01:24:59.915585 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [req-85e6311f-da99-4144-8f24-342d8c131f6c req-1b42108e-2970-4d16-8a80-f9157a86b566 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040206 Sep 06 01:24:59.916410 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 568/1100] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 01:24:59.935095 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-432a6324-111c-49d9-adcc-5d2b665344ae tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:24:59.943592 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-432a6324-111c-49d9-adcc-5d2b665344ae tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d" status: 200 len: 1265 microversion: 2.1 time: 0.169007 Sep 06 01:24:59.944279 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 533/1101] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:24:59 2022] GET /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:25:00.974955 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-81cbe77f-7de9-4c9b-8d05-e42e5a52bff2 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:25:00.975649 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-81cbe77f-7de9-4c9b-8d05-e42e5a52bff2 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 062259ef-5e29-4726-b12f-fde66240b80d] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:25:00.981717 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-81cbe77f-7de9-4c9b-8d05-e42e5a52bff2 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:25:00.982191 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-81cbe77f-7de9-4c9b-8d05-e42e5a52bff2 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:25:00.982624 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-81cbe77f-7de9-4c9b-8d05-e42e5a52bff2 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:25:00.983342 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-81cbe77f-7de9-4c9b-8d05-e42e5a52bff2 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:25:00.983820 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-81cbe77f-7de9-4c9b-8d05-e42e5a52bff2 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:25:00.984247 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-81cbe77f-7de9-4c9b-8d05-e42e5a52bff2 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:25:01.113996 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-81cbe77f-7de9-4c9b-8d05-e42e5a52bff2 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:25:01.122049 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-81cbe77f-7de9-4c9b-8d05-e42e5a52bff2 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d" status: 200 len: 1265 microversion: 2.1 time: 0.151820 Sep 06 01:25:01.122607 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 569/1102] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:25:00 2022] GET /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:25:02.144790 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-81b31ba0-deb3-4eef-817b-cbbe345a2880 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:25:02.145414 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-81b31ba0-deb3-4eef-817b-cbbe345a2880 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 062259ef-5e29-4726-b12f-fde66240b80d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:25:02.152401 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81b31ba0-deb3-4eef-817b-cbbe345a2880 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:25:02.152881 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81b31ba0-deb3-4eef-817b-cbbe345a2880 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:25:02.153312 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81b31ba0-deb3-4eef-817b-cbbe345a2880 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:25:02.154005 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81b31ba0-deb3-4eef-817b-cbbe345a2880 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:25:02.154454 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81b31ba0-deb3-4eef-817b-cbbe345a2880 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:25:02.154899 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81b31ba0-deb3-4eef-817b-cbbe345a2880 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:25:02.287467 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-81b31ba0-deb3-4eef-817b-cbbe345a2880 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:25:02.295334 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-81b31ba0-deb3-4eef-817b-cbbe345a2880 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d" status: 200 len: 1265 microversion: 2.1 time: 0.154665 Sep 06 01:25:02.295953 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 534/1103] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:25:02 2022] GET /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:25:03.317481 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-490e7541-46d3-45af-9577-6b207233c62e tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:25:03.318123 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-490e7541-46d3-45af-9577-6b207233c62e tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 062259ef-5e29-4726-b12f-fde66240b80d] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:25:03.324520 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-490e7541-46d3-45af-9577-6b207233c62e tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:25:03.324992 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-490e7541-46d3-45af-9577-6b207233c62e tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:25:03.325426 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-490e7541-46d3-45af-9577-6b207233c62e tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:25:03.326105 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-490e7541-46d3-45af-9577-6b207233c62e tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:25:03.326554 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-490e7541-46d3-45af-9577-6b207233c62e tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:25:03.326972 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-490e7541-46d3-45af-9577-6b207233c62e tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:25:03.455698 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-490e7541-46d3-45af-9577-6b207233c62e tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:25:03.463765 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-490e7541-46d3-45af-9577-6b207233c62e tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d" status: 200 len: 1265 microversion: 2.1 time: 0.150141 Sep 06 01:25:03.464328 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 570/1104] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:25:03 2022] GET /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:25:04.486411 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-30fa70ba-a7e4-40b2-b4a5-b2e7fa34f2d7 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:25:04.487025 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-30fa70ba-a7e4-40b2-b4a5-b2e7fa34f2d7 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 062259ef-5e29-4726-b12f-fde66240b80d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:25:04.494037 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30fa70ba-a7e4-40b2-b4a5-b2e7fa34f2d7 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:25:04.494512 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30fa70ba-a7e4-40b2-b4a5-b2e7fa34f2d7 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:25:04.494944 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30fa70ba-a7e4-40b2-b4a5-b2e7fa34f2d7 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:25:04.495628 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30fa70ba-a7e4-40b2-b4a5-b2e7fa34f2d7 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:25:04.496103 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30fa70ba-a7e4-40b2-b4a5-b2e7fa34f2d7 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:25:04.496526 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30fa70ba-a7e4-40b2-b4a5-b2e7fa34f2d7 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:25:04.640992 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-30fa70ba-a7e4-40b2-b4a5-b2e7fa34f2d7 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:25:04.649009 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-30fa70ba-a7e4-40b2-b4a5-b2e7fa34f2d7 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d" status: 200 len: 1265 microversion: 2.1 time: 0.166483 Sep 06 01:25:04.649554 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 535/1105] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:25:04 2022] GET /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:25:05.673611 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-3bb1e21b-c92c-4d8e-bed9-1e5f45e53839 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:25:05.674228 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-3bb1e21b-c92c-4d8e-bed9-1e5f45e53839 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 062259ef-5e29-4726-b12f-fde66240b80d] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:25:05.681098 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3bb1e21b-c92c-4d8e-bed9-1e5f45e53839 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:25:05.681578 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3bb1e21b-c92c-4d8e-bed9-1e5f45e53839 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:25:05.682013 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3bb1e21b-c92c-4d8e-bed9-1e5f45e53839 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:25:05.682709 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3bb1e21b-c92c-4d8e-bed9-1e5f45e53839 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:25:05.683159 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3bb1e21b-c92c-4d8e-bed9-1e5f45e53839 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:25:05.683581 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3bb1e21b-c92c-4d8e-bed9-1e5f45e53839 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:25:05.812490 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-3bb1e21b-c92c-4d8e-bed9-1e5f45e53839 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:25:05.820540 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-3bb1e21b-c92c-4d8e-bed9-1e5f45e53839 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d" status: 200 len: 1265 microversion: 2.1 time: 0.152068 Sep 06 01:25:05.821094 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 571/1106] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:25:05 2022] GET /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:25:06.842452 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a8f1be8d-acfa-4cf4-811a-93ccb561247d tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:25:06.843027 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a8f1be8d-acfa-4cf4-811a-93ccb561247d tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 062259ef-5e29-4726-b12f-fde66240b80d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:25:06.849346 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8f1be8d-acfa-4cf4-811a-93ccb561247d tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:25:06.849835 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8f1be8d-acfa-4cf4-811a-93ccb561247d tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:25:06.850281 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8f1be8d-acfa-4cf4-811a-93ccb561247d tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:25:06.850963 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8f1be8d-acfa-4cf4-811a-93ccb561247d tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:25:06.851416 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8f1be8d-acfa-4cf4-811a-93ccb561247d tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:25:06.851868 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8f1be8d-acfa-4cf4-811a-93ccb561247d tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:25:06.978041 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-a8f1be8d-acfa-4cf4-811a-93ccb561247d tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:25:06.985577 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a8f1be8d-acfa-4cf4-811a-93ccb561247d tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d" status: 200 len: 1265 microversion: 2.1 time: 0.147097 Sep 06 01:25:06.986128 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 536/1107] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:25:06 2022] GET /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:25:08.007977 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-000d6648-efc1-4e9e-8af2-95ab6e4ff805 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:25:08.008596 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-000d6648-efc1-4e9e-8af2-95ab6e4ff805 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 062259ef-5e29-4726-b12f-fde66240b80d] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:25:08.011025 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell0:SELECT=2 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:25:08.011670 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell0:SELECT=6 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:25:08.017673 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-000d6648-efc1-4e9e-8af2-95ab6e4ff805 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:25:08.018162 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-000d6648-efc1-4e9e-8af2-95ab6e4ff805 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:25:08.018603 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-000d6648-efc1-4e9e-8af2-95ab6e4ff805 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:25:08.019301 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-000d6648-efc1-4e9e-8af2-95ab6e4ff805 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:25:08.019769 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-000d6648-efc1-4e9e-8af2-95ab6e4ff805 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:25:08.020215 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-000d6648-efc1-4e9e-8af2-95ab6e4ff805 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:25:08.156703 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-000d6648-efc1-4e9e-8af2-95ab6e4ff805 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:25:08.165203 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-000d6648-efc1-4e9e-8af2-95ab6e4ff805 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d" status: 200 len: 1265 microversion: 2.1 time: 0.161130 Sep 06 01:25:08.165764 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 572/1108] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:25:08 2022] GET /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:25:09.187596 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4e3aedc4-e2a9-4950-b414-cff020d46362 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:25:09.188236 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4e3aedc4-e2a9-4950-b414-cff020d46362 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 062259ef-5e29-4726-b12f-fde66240b80d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:25:09.190167 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:25:09.195984 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4e3aedc4-e2a9-4950-b414-cff020d46362 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:25:09.196467 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4e3aedc4-e2a9-4950-b414-cff020d46362 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:25:09.196905 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4e3aedc4-e2a9-4950-b414-cff020d46362 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:25:09.197590 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4e3aedc4-e2a9-4950-b414-cff020d46362 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:25:09.198041 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4e3aedc4-e2a9-4950-b414-cff020d46362 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:25:09.198470 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4e3aedc4-e2a9-4950-b414-cff020d46362 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:25:09.333125 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-4e3aedc4-e2a9-4950-b414-cff020d46362 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:25:09.341626 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4e3aedc4-e2a9-4950-b414-cff020d46362 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d" status: 200 len: 1265 microversion: 2.1 time: 0.157866 Sep 06 01:25:09.342219 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 537/1109] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:25:09 2022] GET /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:25:10.364819 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-4c4fba5c-fd5d-4341-a64f-ce867c7c91bd tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:25:10.365993 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-4c4fba5c-fd5d-4341-a64f-ce867c7c91bd tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 062259ef-5e29-4726-b12f-fde66240b80d] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:25:10.373070 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4c4fba5c-fd5d-4341-a64f-ce867c7c91bd tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:25:10.373547 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4c4fba5c-fd5d-4341-a64f-ce867c7c91bd tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:25:10.373957 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4c4fba5c-fd5d-4341-a64f-ce867c7c91bd tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:25:10.374700 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4c4fba5c-fd5d-4341-a64f-ce867c7c91bd tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:25:10.375143 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4c4fba5c-fd5d-4341-a64f-ce867c7c91bd tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:25:10.375615 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4c4fba5c-fd5d-4341-a64f-ce867c7c91bd tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:25:10.493474 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-795f9688-19fb-4197-9053-887c3d61d0dc req-372f4658-f0d1-46c6-9ff7-b2cfe6115d7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "062259ef-5e29-4726-b12f-fde66240b80d", "name": "network-vif-plugged", "status": "completed", "tag": "c8000dc8-bc3b-4183-b93f-e81f8b5470e7"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:25:10.504211 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-795f9688-19fb-4197-9053-887c3d61d0dc req-372f4658-f0d1-46c6-9ff7-b2cfe6115d7e service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:25:10.504717 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-795f9688-19fb-4197-9053-887c3d61d0dc req-372f4658-f0d1-46c6-9ff7-b2cfe6115d7e service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:25:10.505232 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-795f9688-19fb-4197-9053-887c3d61d0dc req-372f4658-f0d1-46c6-9ff7-b2cfe6115d7e service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:25:10.516502 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-795f9688-19fb-4197-9053-887c3d61d0dc req-372f4658-f0d1-46c6-9ff7-b2cfe6115d7e service nova] Creating event network-vif-plugged:c8000dc8-bc3b-4183-b93f-e81f8b5470e7 for instance 062259ef-5e29-4726-b12f-fde66240b80d on hv-cinder-84773 Sep 06 01:25:10.519327 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-4c4fba5c-fd5d-4341-a64f-ce867c7c91bd tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:25:10.522042 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-795f9688-19fb-4197-9053-887c3d61d0dc req-372f4658-f0d1-46c6-9ff7-b2cfe6115d7e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033093 Sep 06 01:25:10.522627 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 538/1110] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:25:10.528618 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-4c4fba5c-fd5d-4341-a64f-ce867c7c91bd tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d" status: 200 len: 1265 microversion: 2.1 time: 0.167689 Sep 06 01:25:10.529182 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 573/1111] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:25:10 2022] GET /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:25:11.553363 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-87715313-fa20-4c57-8cbc-b2ef1cda831e tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:25:11.554127 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-87715313-fa20-4c57-8cbc-b2ef1cda831e tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 062259ef-5e29-4726-b12f-fde66240b80d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:25:11.560340 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87715313-fa20-4c57-8cbc-b2ef1cda831e tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:25:11.560828 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87715313-fa20-4c57-8cbc-b2ef1cda831e tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:25:11.561267 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87715313-fa20-4c57-8cbc-b2ef1cda831e tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:25:11.561950 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87715313-fa20-4c57-8cbc-b2ef1cda831e tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:25:11.562407 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87715313-fa20-4c57-8cbc-b2ef1cda831e tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:25:11.562829 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87715313-fa20-4c57-8cbc-b2ef1cda831e tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:25:11.697532 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-87715313-fa20-4c57-8cbc-b2ef1cda831e tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:25:11.705788 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-87715313-fa20-4c57-8cbc-b2ef1cda831e tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d" status: 200 len: 1265 microversion: 2.1 time: 0.157624 Sep 06 01:25:11.706524 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 539/1112] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:25:11 2022] GET /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:25:12.729456 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-013907ed-bb58-43e9-a0aa-ac49be8babbc tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:25:12.730072 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-013907ed-bb58-43e9-a0aa-ac49be8babbc tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 062259ef-5e29-4726-b12f-fde66240b80d] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:25:12.736435 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-013907ed-bb58-43e9-a0aa-ac49be8babbc tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:25:12.736908 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-013907ed-bb58-43e9-a0aa-ac49be8babbc tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:25:12.737341 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-013907ed-bb58-43e9-a0aa-ac49be8babbc tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:25:12.738020 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-013907ed-bb58-43e9-a0aa-ac49be8babbc tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:25:12.738465 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-013907ed-bb58-43e9-a0aa-ac49be8babbc tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:25:12.738882 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-013907ed-bb58-43e9-a0aa-ac49be8babbc tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:25:12.869479 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-013907ed-bb58-43e9-a0aa-ac49be8babbc tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:25:12.877153 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-013907ed-bb58-43e9-a0aa-ac49be8babbc tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d" status: 200 len: 1452 microversion: 2.1 time: 0.151542 Sep 06 01:25:12.877714 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 574/1113] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:25:12 2022] GET /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:25:12.898737 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f449b78e-a5d6-4d60-97f9-9bc17613fe7d tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:25:12.899352 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f449b78e-a5d6-4d60-97f9-9bc17613fe7d tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 062259ef-5e29-4726-b12f-fde66240b80d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:25:12.905691 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f449b78e-a5d6-4d60-97f9-9bc17613fe7d tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:25:12.906227 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f449b78e-a5d6-4d60-97f9-9bc17613fe7d tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:25:12.906666 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f449b78e-a5d6-4d60-97f9-9bc17613fe7d tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:25:12.907357 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f449b78e-a5d6-4d60-97f9-9bc17613fe7d tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:25:12.907843 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f449b78e-a5d6-4d60-97f9-9bc17613fe7d tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:25:12.908268 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f449b78e-a5d6-4d60-97f9-9bc17613fe7d tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:25:13.037601 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-f449b78e-a5d6-4d60-97f9-9bc17613fe7d tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:25:13.045487 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f449b78e-a5d6-4d60-97f9-9bc17613fe7d tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d" status: 200 len: 1452 microversion: 2.1 time: 0.150584 Sep 06 01:25:13.046052 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 540/1114] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:25:12 2022] GET /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:25:14.679614 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-d1b0afe5-bf54-45e0-870d-be78b87ee8c9 req-639b0378-0267-49cc-a119-7d38f4aaee70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "062259ef-5e29-4726-b12f-fde66240b80d", "tag": "c8000dc8-bc3b-4183-b93f-e81f8b5470e7"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:25:14.691801 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-d1b0afe5-bf54-45e0-870d-be78b87ee8c9 req-639b0378-0267-49cc-a119-7d38f4aaee70 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:25:14.692272 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-d1b0afe5-bf54-45e0-870d-be78b87ee8c9 req-639b0378-0267-49cc-a119-7d38f4aaee70 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:25:14.692711 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-d1b0afe5-bf54-45e0-870d-be78b87ee8c9 req-639b0378-0267-49cc-a119-7d38f4aaee70 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:25:14.704833 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.compute.server_external_events [req-d1b0afe5-bf54-45e0-870d-be78b87ee8c9 req-639b0378-0267-49cc-a119-7d38f4aaee70 service nova] Creating event network-changed:c8000dc8-bc3b-4183-b93f-e81f8b5470e7 for instance 062259ef-5e29-4726-b12f-fde66240b80d on hv-cinder-84773 Sep 06 01:25:14.710369 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [req-d1b0afe5-bf54-45e0-870d-be78b87ee8c9 req-639b0378-0267-49cc-a119-7d38f4aaee70 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035422 Sep 06 01:25:14.710950 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 575/1115] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 01:27:10.111284 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=20 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:27:10.112038 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=44 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:27:10.116846 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-847e6734-06b8-4a1c-a8e6-9a2263c54f0f tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:27:10.117341 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-847e6734-06b8-4a1c-a8e6-9a2263c54f0f tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 062259ef-5e29-4726-b12f-fde66240b80d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:27:10.124166 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-847e6734-06b8-4a1c-a8e6-9a2263c54f0f tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:27:10.124642 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-847e6734-06b8-4a1c-a8e6-9a2263c54f0f tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:27:10.125069 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-847e6734-06b8-4a1c-a8e6-9a2263c54f0f tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:27:10.125748 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-847e6734-06b8-4a1c-a8e6-9a2263c54f0f tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:27:10.126199 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-847e6734-06b8-4a1c-a8e6-9a2263c54f0f tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:27:10.126616 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-847e6734-06b8-4a1c-a8e6-9a2263c54f0f tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:27:10.150889 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-847e6734-06b8-4a1c-a8e6-9a2263c54f0f tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 062259ef-5e29-4726-b12f-fde66240b80d] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 01:27:10.224758 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-847e6734-06b8-4a1c-a8e6-9a2263c54f0f tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "DELETE /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d" status: 204 len: 0 microversion: 2.1 time: 0.115360 Sep 06 01:27:10.225642 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 541/1116] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 6 01:27:10 2022] DELETE /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 01:27:10.231617 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a4e7ff82-f6f4-4c3c-aa6f-22702bc88717] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 06 01:27:10.232267 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:27:10.232995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell1:SELECT=48 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:27:10.234420 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 06 01:27:10.234602 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Tue Sep 6 01:27:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d (ip 10.222.0.23) !!! Sep 06 01:27:10.241686 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-4cfadc8d-294a-4876-a5ea-d0e9ed24cc77 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:27:10.242393 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-4cfadc8d-294a-4876-a5ea-d0e9ed24cc77 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 062259ef-5e29-4726-b12f-fde66240b80d] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:27:10.252837 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4cfadc8d-294a-4876-a5ea-d0e9ed24cc77 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:27:10.253327 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4cfadc8d-294a-4876-a5ea-d0e9ed24cc77 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:27:10.253764 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4cfadc8d-294a-4876-a5ea-d0e9ed24cc77 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:27:10.254456 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4cfadc8d-294a-4876-a5ea-d0e9ed24cc77 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:27:10.254913 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4cfadc8d-294a-4876-a5ea-d0e9ed24cc77 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:27:10.255343 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-4cfadc8d-294a-4876-a5ea-d0e9ed24cc77 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:27:10.387150 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-4cfadc8d-294a-4876-a5ea-d0e9ed24cc77 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:27:10.395727 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-4cfadc8d-294a-4876-a5ea-d0e9ed24cc77 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d" status: 200 len: 1576 microversion: 2.1 time: 0.165120 Sep 06 01:27:10.396330 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 576/1117] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:27:10 2022] GET /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:27:11.420249 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4894b91b-2db9-40cf-a365-adc964c5b621 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:27:11.420949 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4894b91b-2db9-40cf-a365-adc964c5b621 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 062259ef-5e29-4726-b12f-fde66240b80d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:27:11.427929 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4894b91b-2db9-40cf-a365-adc964c5b621 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:27:11.428404 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4894b91b-2db9-40cf-a365-adc964c5b621 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:27:11.428837 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4894b91b-2db9-40cf-a365-adc964c5b621 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:27:11.429508 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4894b91b-2db9-40cf-a365-adc964c5b621 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:27:11.429957 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4894b91b-2db9-40cf-a365-adc964c5b621 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:27:11.430372 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4894b91b-2db9-40cf-a365-adc964c5b621 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:27:11.560008 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-4894b91b-2db9-40cf-a365-adc964c5b621 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:27:11.567682 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4894b91b-2db9-40cf-a365-adc964c5b621 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d" status: 200 len: 1576 microversion: 2.1 time: 0.151705 Sep 06 01:27:11.568276 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 542/1118] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:27:11 2022] GET /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:27:12.544927 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-b7f4f3f9-9694-462f-8edf-e6fb1375c24d req-82d7c0b3-aef5-4539-a834-2bc4b7e798a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "062259ef-5e29-4726-b12f-fde66240b80d", "name": "network-vif-deleted", "tag": "c8000dc8-bc3b-4183-b93f-e81f8b5470e7"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:27:12.562004 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO oslo.messaging._drivers.impl_rabbit [-] [a4e7ff82-f6f4-4c3c-aa6f-22702bc88717] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 49964. Sep 06 01:27:12.568152 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-b7f4f3f9-9694-462f-8edf-e6fb1375c24d req-82d7c0b3-aef5-4539-a834-2bc4b7e798a2 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:27:12.568712 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-b7f4f3f9-9694-462f-8edf-e6fb1375c24d req-82d7c0b3-aef5-4539-a834-2bc4b7e798a2 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:27:12.569440 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-b7f4f3f9-9694-462f-8edf-e6fb1375c24d req-82d7c0b3-aef5-4539-a834-2bc4b7e798a2 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:27:12.588149 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.compute.server_external_events [req-b7f4f3f9-9694-462f-8edf-e6fb1375c24d req-82d7c0b3-aef5-4539-a834-2bc4b7e798a2 service nova] Creating event network-vif-deleted:c8000dc8-bc3b-4183-b93f-e81f8b5470e7 for instance 062259ef-5e29-4726-b12f-fde66240b80d on hv-cinder-84773 Sep 06 01:27:12.594219 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-95b378ba-290d-4b47-874e-94b0769182eb tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:27:12.595029 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-95b378ba-290d-4b47-874e-94b0769182eb tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 062259ef-5e29-4726-b12f-fde66240b80d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:27:12.602975 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95b378ba-290d-4b47-874e-94b0769182eb tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:27:12.603582 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95b378ba-290d-4b47-874e-94b0769182eb tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:27:12.604134 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95b378ba-290d-4b47-874e-94b0769182eb tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:27:12.604938 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95b378ba-290d-4b47-874e-94b0769182eb tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:27:12.605748 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95b378ba-290d-4b47-874e-94b0769182eb tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:27:12.606227 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95b378ba-290d-4b47-874e-94b0769182eb tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:27:12.612302 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [req-b7f4f3f9-9694-462f-8edf-e6fb1375c24d req-82d7c0b3-aef5-4539-a834-2bc4b7e798a2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067654 Sep 06 01:27:12.614166 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 577/1119] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:27:12.676764 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-95b378ba-290d-4b47-874e-94b0769182eb tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:27:12.684997 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-95b378ba-290d-4b47-874e-94b0769182eb tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d" status: 200 len: 1224 microversion: 2.1 time: 0.097581 Sep 06 01:27:12.685571 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 543/1120] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:27:12 2022] GET /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:27:13.709914 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-2b7a9085-8e1e-43d5-a096-76937a4c24a9 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:27:13.711273 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-2b7a9085-8e1e-43d5-a096-76937a4c24a9 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 062259ef-5e29-4726-b12f-fde66240b80d] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:27:13.717911 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2b7a9085-8e1e-43d5-a096-76937a4c24a9 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:27:13.718325 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2b7a9085-8e1e-43d5-a096-76937a4c24a9 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:27:13.718754 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2b7a9085-8e1e-43d5-a096-76937a4c24a9 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:27:13.719451 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2b7a9085-8e1e-43d5-a096-76937a4c24a9 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:27:13.719933 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2b7a9085-8e1e-43d5-a096-76937a4c24a9 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:27:13.720352 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-2b7a9085-8e1e-43d5-a096-76937a4c24a9 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:27:13.737846 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.wsgi [None req-2b7a9085-8e1e-43d5-a096-76937a4c24a9 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] HTTP exception thrown: Instance 062259ef-5e29-4726-b12f-fde66240b80d could not be found. Sep 06 01:27:13.740089 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-2b7a9085-8e1e-43d5-a096-76937a4c24a9 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Request method failure captured: Sep 06 01:27:13.740089 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: request: GET /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d HTTP/1.1 Sep 06 01:27:13.740089 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept: application/json Sep 06 01:27:13.740089 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept-Encoding: identity Sep 06 01:27:13.740089 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Connection: close Sep 06 01:27:13.740089 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Length: 0 Sep 06 01:27:13.740089 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Type: application/json Sep 06 01:27:13.740089 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Host: 10.222.0.23 Sep 06 01:27:13.740089 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Openstack-System-Scope: None Sep 06 01:27:13.740089 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: User-Agent: python-urllib3/1.26.12 Sep 06 01:27:13.740089 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Auth-Token: gAAAAABjFqFUGRDtvP7kikq2u8OKAD3gLCAs2_SwVmWbc8V_RHR4nErzGcYvrFO-vyEdydLblKWwtXYvBtV3tVFqW3EWpy0-YMqKEle_KOqqbvCYoqVcEFz7Ca6sjNfy9srnZpYUdiZQr9y5YBjT5yBVEwBW_DIZ2zYbvapfTljIQhHgx6cpMkQ Sep 06 01:27:13.740089 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Id: None Sep 06 01:27:13.740089 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Name: None Sep 06 01:27:13.740089 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Identity-Status: Confirmed Sep 06 01:27:13.740089 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Is-Admin-Project: True Sep 06 01:27:13.740089 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Id: default Sep 06 01:27:13.740089 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Name: Default Sep 06 01:27:13.740089 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Id: 333491050689469789d7fd61b4d70cf8 Sep 06 01:27:13.740089 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Name: tempest-TestVolumeBootPattern-2054739329 Sep 06 01:27:13.740089 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Role: reader,member Sep 06 01:27:13.740089 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Roles: reader,member Sep 06 01:27:13.741946 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/333491050689469789d7fd61b4d70cf8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/333491050689469789d7fd61b4d70cf8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_333491050689469789d7fd61b4d70cf8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/333491050689469789d7fd61b4d70cf8"}]}] Sep 06 01:27:13.741946 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant: tempest-TestVolumeBootPattern-2054739329 Sep 06 01:27:13.741946 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Id: 333491050689469789d7fd61b4d70cf8 Sep 06 01:27:13.741946 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Name: tempest-TestVolumeBootPattern-2054739329 Sep 06 01:27:13.741946 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User: tempest-TestVolumeBootPattern-2054739329-project Sep 06 01:27:13.741946 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Id: default Sep 06 01:27:13.741946 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Name: Default Sep 06 01:27:13.741946 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Id: e58ada13a75445df97d8b6d1e3ea9c50 Sep 06 01:27:13.741946 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Name: tempest-TestVolumeBootPattern-2054739329-project Sep 06 01:27:13.741946 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: method: > Sep 06 01:27:13.741946 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: exception: Instance 062259ef-5e29-4726-b12f-fde66240b80d could not be found. Sep 06 01:27:13.741946 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: action_args: {'id': '062259ef-5e29-4726-b12f-fde66240b80d'} Sep 06 01:27:13.743502 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:27:13.743502 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:27:13.743502 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 01:27:13.743502 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 01:27:13.743502 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 01:27:13.743502 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 01:27:13.743502 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 01:27:13.743502 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 01:27:13.743502 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 01:27:13.743502 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 01:27:13.743502 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 062259ef-5e29-4726-b12f-fde66240b80d could not be found. Sep 06 01:27:13.743502 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:27:13.743502 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:27:13.743502 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:27:13.743502 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:27:13.743502 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:27:13.743502 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:27:13.743502 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:27:13.743502 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:27:13.743502 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:27:13.745136 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:27:13.745136 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 01:27:13.745136 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 01:27:13.745136 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 01:27:13.745136 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 01:27:13.745136 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 01:27:13.745136 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:27:13.745136 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 062259ef-5e29-4726-b12f-fde66240b80d could not be found. Sep 06 01:27:13.745136 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:27:13.745136 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:27:13.745136 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:27:13.745136 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:27:13.745136 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:27:13.745136 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:27:13.745136 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:27:13.745136 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:27:13.745136 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 062259ef-5e29-4726-b12f-fde66240b80d could not be found. Sep 06 01:27:13.745136 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:27:13.746454 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-2b7a9085-8e1e-43d5-a096-76937a4c24a9 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Returning 404 to user: Instance 062259ef-5e29-4726-b12f-fde66240b80d could not be found. {{(pid=120580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:27:13.746454 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-2b7a9085-8e1e-43d5-a096-76937a4c24a9 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d" status: 404 len: 111 microversion: 2.1 time: 0.037097 Sep 06 01:27:13.746454 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 578/1121] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:27:13 2022] GET /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 01:27:13.790710 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-55c0dd53-ead0-4c03-9a14-3c6ef46bdbb7 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-390645078", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-635459421", "security_groups": [{"name": "tempest-secgroup-smoke-1916685125"}], "block_device_mapping_v2": [{"uuid": "f38ae399-7281-4a8d-a046-fb3fb10405a9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d895c0aa-bda4-4613-b99a-7874b7d4b4f0"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:27:13.902723 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-55c0dd53-ead0-4c03-9a14-3c6ef46bdbb7 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] validate_networks() for [('d895c0aa-bda4-4613-b99a-7874b7d4b4f0', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 01:27:14.547007 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-55c0dd53-ead0-4c03-9a14-3c6ef46bdbb7 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 01:27:14.547423 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-55c0dd53-ead0-4c03-9a14-3c6ef46bdbb7 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 01:27:14.547923 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-55c0dd53-ead0-4c03-9a14-3c6ef46bdbb7 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 01:27:14.548325 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-55c0dd53-ead0-4c03-9a14-3c6ef46bdbb7 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 01:27:14.548736 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-55c0dd53-ead0-4c03-9a14-3c6ef46bdbb7 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 01:27:14.557757 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55c0dd53-ead0-4c03-9a14-3c6ef46bdbb7 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:27:14.558226 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55c0dd53-ead0-4c03-9a14-3c6ef46bdbb7 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:27:14.558657 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55c0dd53-ead0-4c03-9a14-3c6ef46bdbb7 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:27:14.559376 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55c0dd53-ead0-4c03-9a14-3c6ef46bdbb7 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:27:14.559849 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55c0dd53-ead0-4c03-9a14-3c6ef46bdbb7 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:27:14.560268 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55c0dd53-ead0-4c03-9a14-3c6ef46bdbb7 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:27:14.576754 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.quota [None req-55c0dd53-ead0-4c03-9a14-3c6ef46bdbb7 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Getting quotas for project 333491050689469789d7fd61b4d70cf8. Resources: {'instances', 'ram', 'cores'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 01:27:14.580608 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.quota [None req-55c0dd53-ead0-4c03-9a14-3c6ef46bdbb7 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Getting quotas for user e58ada13a75445df97d8b6d1e3ea9c50 and project 333491050689469789d7fd61b4d70cf8. Resources: {'instances', 'ram', 'cores'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 01:27:14.636945 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-55c0dd53-ead0-4c03-9a14-3c6ef46bdbb7 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 01:27:14.639066 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-55c0dd53-ead0-4c03-9a14-3c6ef46bdbb7 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 3812b0ec-ef45-4539-9ef6-30e67af033a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f38ae399-7281-4a8d-a046-fb3fb10405a9',volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 01:27:14.763743 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-55c0dd53-ead0-4c03-9a14-3c6ef46bdbb7 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.977148 Sep 06 01:27:14.764429 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 544/1122] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Sep 6 01:27:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 01:27:14.775359 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-1f00417e-f1d2-4a90-8c7b-d161823a03be tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:27:14.776095 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-1f00417e-f1d2-4a90-8c7b-d161823a03be tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 3812b0ec-ef45-4539-9ef6-30e67af033a8] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:27:14.832613 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-1f00417e-f1d2-4a90-8c7b-d161823a03be tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:27:14.840310 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-1f00417e-f1d2-4a90-8c7b-d161823a03be tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/3812b0ec-ef45-4539-9ef6-30e67af033a8" status: 200 len: 1093 microversion: 2.1 time: 0.068767 Sep 06 01:27:14.841149 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 579/1123] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:27:14 2022] GET /compute/v2.1/servers/3812b0ec-ef45-4539-9ef6-30e67af033a8 => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:27:15.863034 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-23c5d5d9-5b05-416b-a73f-56c8914bca27 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:27:15.864382 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-23c5d5d9-5b05-416b-a73f-56c8914bca27 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 3812b0ec-ef45-4539-9ef6-30e67af033a8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:27:15.870352 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23c5d5d9-5b05-416b-a73f-56c8914bca27 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:27:15.870892 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23c5d5d9-5b05-416b-a73f-56c8914bca27 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:27:15.871329 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23c5d5d9-5b05-416b-a73f-56c8914bca27 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:27:15.872114 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23c5d5d9-5b05-416b-a73f-56c8914bca27 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:27:15.872574 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23c5d5d9-5b05-416b-a73f-56c8914bca27 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:27:15.873011 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23c5d5d9-5b05-416b-a73f-56c8914bca27 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:27:15.939171 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-23c5d5d9-5b05-416b-a73f-56c8914bca27 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:27:15.946786 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-23c5d5d9-5b05-416b-a73f-56c8914bca27 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/3812b0ec-ef45-4539-9ef6-30e67af033a8" status: 200 len: 1209 microversion: 2.1 time: 0.088224 Sep 06 01:27:15.947355 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 545/1124] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:27:15 2022] GET /compute/v2.1/servers/3812b0ec-ef45-4539-9ef6-30e67af033a8 => generated 1209 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:27:16.970434 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-85bf8ac7-ac9e-41e6-825e-cc078bc60f28 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:27:16.971132 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-85bf8ac7-ac9e-41e6-825e-cc078bc60f28 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 3812b0ec-ef45-4539-9ef6-30e67af033a8] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:27:16.977824 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-85bf8ac7-ac9e-41e6-825e-cc078bc60f28 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:27:16.978375 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-85bf8ac7-ac9e-41e6-825e-cc078bc60f28 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:27:16.978834 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-85bf8ac7-ac9e-41e6-825e-cc078bc60f28 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:27:16.979550 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-85bf8ac7-ac9e-41e6-825e-cc078bc60f28 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:27:16.980021 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-85bf8ac7-ac9e-41e6-825e-cc078bc60f28 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:27:16.980442 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-85bf8ac7-ac9e-41e6-825e-cc078bc60f28 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:27:17.054651 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-cdafcb17-18fa-4fe1-8adf-32c0d946153a req-957ff4d4-59f2-41a6-820e-61ba2f7df66a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3812b0ec-ef45-4539-9ef6-30e67af033a8", "tag": "81d888f2-b5fe-4da9-9989-96d303763c2a"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:27:17.066561 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-cdafcb17-18fa-4fe1-8adf-32c0d946153a req-957ff4d4-59f2-41a6-820e-61ba2f7df66a service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:27:17.067888 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-cdafcb17-18fa-4fe1-8adf-32c0d946153a req-957ff4d4-59f2-41a6-820e-61ba2f7df66a service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:27:17.068397 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-cdafcb17-18fa-4fe1-8adf-32c0d946153a req-957ff4d4-59f2-41a6-820e-61ba2f7df66a service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:27:17.080103 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-cdafcb17-18fa-4fe1-8adf-32c0d946153a req-957ff4d4-59f2-41a6-820e-61ba2f7df66a service nova] Creating event network-changed:81d888f2-b5fe-4da9-9989-96d303763c2a for instance 3812b0ec-ef45-4539-9ef6-30e67af033a8 on hv-cinder-84773 Sep 06 01:27:17.085588 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-cdafcb17-18fa-4fe1-8adf-32c0d946153a req-957ff4d4-59f2-41a6-820e-61ba2f7df66a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035363 Sep 06 01:27:17.086762 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 546/1125] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 01:27:17.122549 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-85bf8ac7-ac9e-41e6-825e-cc078bc60f28 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:27:17.130850 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-85bf8ac7-ac9e-41e6-825e-cc078bc60f28 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/3812b0ec-ef45-4539-9ef6-30e67af033a8" status: 200 len: 1265 microversion: 2.1 time: 0.164280 Sep 06 01:27:17.131404 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 580/1126] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:27:16 2022] GET /compute/v2.1/servers/3812b0ec-ef45-4539-9ef6-30e67af033a8 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:27:18.154564 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b3232bcb-104b-4305-8a89-47cb93752369 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:27:18.155275 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b3232bcb-104b-4305-8a89-47cb93752369 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 3812b0ec-ef45-4539-9ef6-30e67af033a8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:27:18.161928 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b3232bcb-104b-4305-8a89-47cb93752369 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:27:18.162410 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b3232bcb-104b-4305-8a89-47cb93752369 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:27:18.162850 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b3232bcb-104b-4305-8a89-47cb93752369 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:27:18.163546 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b3232bcb-104b-4305-8a89-47cb93752369 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:27:18.164296 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b3232bcb-104b-4305-8a89-47cb93752369 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:27:18.164730 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b3232bcb-104b-4305-8a89-47cb93752369 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:27:18.300162 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-b3232bcb-104b-4305-8a89-47cb93752369 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:27:18.309109 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b3232bcb-104b-4305-8a89-47cb93752369 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/3812b0ec-ef45-4539-9ef6-30e67af033a8" status: 200 len: 1265 microversion: 2.1 time: 0.159147 Sep 06 01:27:18.310024 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 547/1127] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:27:18 2022] GET /compute/v2.1/servers/3812b0ec-ef45-4539-9ef6-30e67af033a8 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:27:19.333703 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-7e640b53-4742-4f82-adcb-64079401ffef tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:27:19.334318 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-7e640b53-4742-4f82-adcb-64079401ffef tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 3812b0ec-ef45-4539-9ef6-30e67af033a8] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:27:19.340826 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7e640b53-4742-4f82-adcb-64079401ffef tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:27:19.341306 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7e640b53-4742-4f82-adcb-64079401ffef tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:27:19.341736 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7e640b53-4742-4f82-adcb-64079401ffef tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:27:19.342417 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7e640b53-4742-4f82-adcb-64079401ffef tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:27:19.342861 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7e640b53-4742-4f82-adcb-64079401ffef tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:27:19.343279 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7e640b53-4742-4f82-adcb-64079401ffef tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:27:19.471402 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-7e640b53-4742-4f82-adcb-64079401ffef tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:27:19.479204 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-7e640b53-4742-4f82-adcb-64079401ffef tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/3812b0ec-ef45-4539-9ef6-30e67af033a8" status: 200 len: 1265 microversion: 2.1 time: 0.150164 Sep 06 01:27:19.479923 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 581/1128] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:27:19 2022] GET /compute/v2.1/servers/3812b0ec-ef45-4539-9ef6-30e67af033a8 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:27:20.501664 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-777654db-ec43-4afd-8c2c-7f96e8f5fdba tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:27:20.502329 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-777654db-ec43-4afd-8c2c-7f96e8f5fdba tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 3812b0ec-ef45-4539-9ef6-30e67af033a8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:27:20.508767 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-777654db-ec43-4afd-8c2c-7f96e8f5fdba tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:27:20.509243 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-777654db-ec43-4afd-8c2c-7f96e8f5fdba tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:27:20.509674 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-777654db-ec43-4afd-8c2c-7f96e8f5fdba tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:27:20.510355 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-777654db-ec43-4afd-8c2c-7f96e8f5fdba tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:27:20.510795 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-777654db-ec43-4afd-8c2c-7f96e8f5fdba tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:27:20.511211 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-777654db-ec43-4afd-8c2c-7f96e8f5fdba tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:27:20.639094 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-777654db-ec43-4afd-8c2c-7f96e8f5fdba tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:27:20.647148 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-777654db-ec43-4afd-8c2c-7f96e8f5fdba tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/3812b0ec-ef45-4539-9ef6-30e67af033a8" status: 200 len: 1265 microversion: 2.1 time: 0.149314 Sep 06 01:27:20.647710 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 548/1129] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:27:20 2022] GET /compute/v2.1/servers/3812b0ec-ef45-4539-9ef6-30e67af033a8 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:27:21.670208 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-016b073f-56ad-4e9c-95fc-c7be73acbedd tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:27:21.670848 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-016b073f-56ad-4e9c-95fc-c7be73acbedd tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 3812b0ec-ef45-4539-9ef6-30e67af033a8] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:27:21.677422 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-016b073f-56ad-4e9c-95fc-c7be73acbedd tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:27:21.677900 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-016b073f-56ad-4e9c-95fc-c7be73acbedd tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:27:21.678331 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-016b073f-56ad-4e9c-95fc-c7be73acbedd tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:27:21.679016 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-016b073f-56ad-4e9c-95fc-c7be73acbedd tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:27:21.679464 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-016b073f-56ad-4e9c-95fc-c7be73acbedd tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:27:21.679917 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-016b073f-56ad-4e9c-95fc-c7be73acbedd tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:27:21.812205 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-016b073f-56ad-4e9c-95fc-c7be73acbedd tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:27:21.820328 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-016b073f-56ad-4e9c-95fc-c7be73acbedd tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/3812b0ec-ef45-4539-9ef6-30e67af033a8" status: 200 len: 1265 microversion: 2.1 time: 0.154020 Sep 06 01:27:21.820887 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 582/1130] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:27:21 2022] GET /compute/v2.1/servers/3812b0ec-ef45-4539-9ef6-30e67af033a8 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:27:22.843412 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e7a65ad0-8353-4888-9595-345898a7fab2 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:27:22.844003 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e7a65ad0-8353-4888-9595-345898a7fab2 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 3812b0ec-ef45-4539-9ef6-30e67af033a8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:27:22.850081 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7a65ad0-8353-4888-9595-345898a7fab2 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:27:22.850564 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7a65ad0-8353-4888-9595-345898a7fab2 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:27:22.851003 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7a65ad0-8353-4888-9595-345898a7fab2 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:27:22.851689 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7a65ad0-8353-4888-9595-345898a7fab2 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:27:22.852174 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7a65ad0-8353-4888-9595-345898a7fab2 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:27:22.852601 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7a65ad0-8353-4888-9595-345898a7fab2 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:27:22.980192 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-e7a65ad0-8353-4888-9595-345898a7fab2 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:27:22.987830 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e7a65ad0-8353-4888-9595-345898a7fab2 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/3812b0ec-ef45-4539-9ef6-30e67af033a8" status: 200 len: 1265 microversion: 2.1 time: 0.148360 Sep 06 01:27:22.988916 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 549/1131] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:27:22 2022] GET /compute/v2.1/servers/3812b0ec-ef45-4539-9ef6-30e67af033a8 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:27:24.010609 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-43166eed-ed93-4c68-b21d-73619db49ddc tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:27:24.011230 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-43166eed-ed93-4c68-b21d-73619db49ddc tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 3812b0ec-ef45-4539-9ef6-30e67af033a8] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:27:24.017655 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-43166eed-ed93-4c68-b21d-73619db49ddc tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:27:24.018137 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-43166eed-ed93-4c68-b21d-73619db49ddc tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:27:24.018571 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-43166eed-ed93-4c68-b21d-73619db49ddc tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:27:24.019259 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-43166eed-ed93-4c68-b21d-73619db49ddc tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:27:24.019716 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-43166eed-ed93-4c68-b21d-73619db49ddc tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:27:24.020167 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-43166eed-ed93-4c68-b21d-73619db49ddc tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:27:24.149668 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-43166eed-ed93-4c68-b21d-73619db49ddc tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:27:24.157333 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-43166eed-ed93-4c68-b21d-73619db49ddc tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/3812b0ec-ef45-4539-9ef6-30e67af033a8" status: 200 len: 1265 microversion: 2.1 time: 0.150618 Sep 06 01:27:24.157903 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 583/1132] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:27:24 2022] GET /compute/v2.1/servers/3812b0ec-ef45-4539-9ef6-30e67af033a8 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:27:25.180794 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9b11e1d8-75df-4d82-8905-a463937fe43e tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:27:25.181456 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9b11e1d8-75df-4d82-8905-a463937fe43e tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 3812b0ec-ef45-4539-9ef6-30e67af033a8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:27:25.183993 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:27:25.184646 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:27:25.190526 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b11e1d8-75df-4d82-8905-a463937fe43e tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:27:25.191008 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b11e1d8-75df-4d82-8905-a463937fe43e tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:27:25.192021 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b11e1d8-75df-4d82-8905-a463937fe43e tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:27:25.192719 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b11e1d8-75df-4d82-8905-a463937fe43e tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:27:25.193173 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b11e1d8-75df-4d82-8905-a463937fe43e tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:27:25.193594 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b11e1d8-75df-4d82-8905-a463937fe43e tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:27:25.328409 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-9b11e1d8-75df-4d82-8905-a463937fe43e tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:27:25.336176 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9b11e1d8-75df-4d82-8905-a463937fe43e tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/3812b0ec-ef45-4539-9ef6-30e67af033a8" status: 200 len: 1265 microversion: 2.1 time: 0.159212 Sep 06 01:27:25.336750 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 550/1133] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:27:25 2022] GET /compute/v2.1/servers/3812b0ec-ef45-4539-9ef6-30e67af033a8 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:27:26.358994 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-9c9de6f4-2b6a-4326-aabb-e68794a4f32b tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:27:26.359533 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-9c9de6f4-2b6a-4326-aabb-e68794a4f32b tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 3812b0ec-ef45-4539-9ef6-30e67af033a8] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:27:26.361520 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell0:SELECT=2 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:27:26.367854 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9c9de6f4-2b6a-4326-aabb-e68794a4f32b tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:27:26.368333 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9c9de6f4-2b6a-4326-aabb-e68794a4f32b tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:27:26.368769 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9c9de6f4-2b6a-4326-aabb-e68794a4f32b tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:27:26.369457 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9c9de6f4-2b6a-4326-aabb-e68794a4f32b tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:27:26.369908 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9c9de6f4-2b6a-4326-aabb-e68794a4f32b tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:27:26.370333 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-9c9de6f4-2b6a-4326-aabb-e68794a4f32b tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:27:26.496305 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-9c9de6f4-2b6a-4326-aabb-e68794a4f32b tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:27:26.503854 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-9c9de6f4-2b6a-4326-aabb-e68794a4f32b tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/3812b0ec-ef45-4539-9ef6-30e67af033a8" status: 200 len: 1265 microversion: 2.1 time: 0.148732 Sep 06 01:27:26.504419 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 584/1134] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:27:26 2022] GET /compute/v2.1/servers/3812b0ec-ef45-4539-9ef6-30e67af033a8 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:27:27.247144 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-94831d6e-32ba-482d-8cdf-25c06a76eb99 req-0ded97e8-e7c5-43ad-878d-7ccdf531930d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3812b0ec-ef45-4539-9ef6-30e67af033a8", "name": "network-vif-plugged", "status": "completed", "tag": "81d888f2-b5fe-4da9-9989-96d303763c2a"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:27:27.260414 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-94831d6e-32ba-482d-8cdf-25c06a76eb99 req-0ded97e8-e7c5-43ad-878d-7ccdf531930d service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:27:27.260904 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-94831d6e-32ba-482d-8cdf-25c06a76eb99 req-0ded97e8-e7c5-43ad-878d-7ccdf531930d service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:27:27.261700 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-94831d6e-32ba-482d-8cdf-25c06a76eb99 req-0ded97e8-e7c5-43ad-878d-7ccdf531930d service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:27:27.273805 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-94831d6e-32ba-482d-8cdf-25c06a76eb99 req-0ded97e8-e7c5-43ad-878d-7ccdf531930d service nova] Creating event network-vif-plugged:81d888f2-b5fe-4da9-9989-96d303763c2a for instance 3812b0ec-ef45-4539-9ef6-30e67af033a8 on hv-cinder-84773 Sep 06 01:27:27.278879 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-94831d6e-32ba-482d-8cdf-25c06a76eb99 req-0ded97e8-e7c5-43ad-878d-7ccdf531930d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035500 Sep 06 01:27:27.279652 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 551/1135] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:27:27.526363 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-aa56c712-a35d-4c04-82a7-32eb38d0f9ee tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:27:27.526981 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-aa56c712-a35d-4c04-82a7-32eb38d0f9ee tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 3812b0ec-ef45-4539-9ef6-30e67af033a8] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:27:27.533220 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-aa56c712-a35d-4c04-82a7-32eb38d0f9ee tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:27:27.533707 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-aa56c712-a35d-4c04-82a7-32eb38d0f9ee tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:27:27.534138 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-aa56c712-a35d-4c04-82a7-32eb38d0f9ee tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:27:27.535442 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-aa56c712-a35d-4c04-82a7-32eb38d0f9ee tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:27:27.535932 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-aa56c712-a35d-4c04-82a7-32eb38d0f9ee tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:27:27.536354 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-aa56c712-a35d-4c04-82a7-32eb38d0f9ee tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:27:27.666497 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-aa56c712-a35d-4c04-82a7-32eb38d0f9ee tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:27:27.674082 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-aa56c712-a35d-4c04-82a7-32eb38d0f9ee tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/3812b0ec-ef45-4539-9ef6-30e67af033a8" status: 200 len: 1265 microversion: 2.1 time: 0.151553 Sep 06 01:27:27.674643 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 585/1136] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:27:27 2022] GET /compute/v2.1/servers/3812b0ec-ef45-4539-9ef6-30e67af033a8 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:27:28.698051 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5b330e11-e4a8-4707-acdd-59baf5c5871d tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:27:28.698751 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5b330e11-e4a8-4707-acdd-59baf5c5871d tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 3812b0ec-ef45-4539-9ef6-30e67af033a8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:27:28.705318 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b330e11-e4a8-4707-acdd-59baf5c5871d tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:27:28.705795 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b330e11-e4a8-4707-acdd-59baf5c5871d tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:27:28.706227 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b330e11-e4a8-4707-acdd-59baf5c5871d tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:27:28.707505 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b330e11-e4a8-4707-acdd-59baf5c5871d tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:27:28.707984 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b330e11-e4a8-4707-acdd-59baf5c5871d tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:27:28.708411 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b330e11-e4a8-4707-acdd-59baf5c5871d tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:27:28.840173 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-5b330e11-e4a8-4707-acdd-59baf5c5871d tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:27:28.847950 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5b330e11-e4a8-4707-acdd-59baf5c5871d tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/3812b0ec-ef45-4539-9ef6-30e67af033a8" status: 200 len: 1453 microversion: 2.1 time: 0.154483 Sep 06 01:27:28.848532 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 552/1137] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:27:28 2022] GET /compute/v2.1/servers/3812b0ec-ef45-4539-9ef6-30e67af033a8 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:27:28.870232 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-3f28aeb8-b286-44d7-a79b-fdb31b95edf8 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:27:28.870843 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-3f28aeb8-b286-44d7-a79b-fdb31b95edf8 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 3812b0ec-ef45-4539-9ef6-30e67af033a8] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:27:28.877144 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3f28aeb8-b286-44d7-a79b-fdb31b95edf8 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:27:28.877619 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3f28aeb8-b286-44d7-a79b-fdb31b95edf8 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:27:28.878050 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3f28aeb8-b286-44d7-a79b-fdb31b95edf8 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:27:28.879332 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3f28aeb8-b286-44d7-a79b-fdb31b95edf8 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:27:28.879800 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3f28aeb8-b286-44d7-a79b-fdb31b95edf8 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:27:28.880225 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-3f28aeb8-b286-44d7-a79b-fdb31b95edf8 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:27:29.009682 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-3f28aeb8-b286-44d7-a79b-fdb31b95edf8 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:27:29.017316 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-3f28aeb8-b286-44d7-a79b-fdb31b95edf8 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/3812b0ec-ef45-4539-9ef6-30e67af033a8" status: 200 len: 1453 microversion: 2.1 time: 0.150989 Sep 06 01:27:29.017871 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 586/1138] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:27:28 2022] GET /compute/v2.1/servers/3812b0ec-ef45-4539-9ef6-30e67af033a8 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:27:30.561889 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-a9b02dd8-faf2-4141-be67-edeff72bcb07 req-516edcc7-a851-4e8c-a1ea-b68fc99e4b4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3812b0ec-ef45-4539-9ef6-30e67af033a8", "tag": "81d888f2-b5fe-4da9-9989-96d303763c2a"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:27:30.572018 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a9b02dd8-faf2-4141-be67-edeff72bcb07 req-516edcc7-a851-4e8c-a1ea-b68fc99e4b4f service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:27:30.572492 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a9b02dd8-faf2-4141-be67-edeff72bcb07 req-516edcc7-a851-4e8c-a1ea-b68fc99e4b4f service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:27:30.573142 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a9b02dd8-faf2-4141-be67-edeff72bcb07 req-516edcc7-a851-4e8c-a1ea-b68fc99e4b4f service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:27:30.584725 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-a9b02dd8-faf2-4141-be67-edeff72bcb07 req-516edcc7-a851-4e8c-a1ea-b68fc99e4b4f service nova] Creating event network-changed:81d888f2-b5fe-4da9-9989-96d303763c2a for instance 3812b0ec-ef45-4539-9ef6-30e67af033a8 on hv-cinder-84773 Sep 06 01:27:30.589575 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-a9b02dd8-faf2-4141-be67-edeff72bcb07 req-516edcc7-a851-4e8c-a1ea-b68fc99e4b4f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031344 Sep 06 01:27:30.590165 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 553/1139] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:29:06.790266 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_api:SELECT=24 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:29:06.791023 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell1:SELECT=52 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:29:06.791834 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 01:29:06.792053 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Tue Sep 6 01:29:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Sep 06 01:29:06.797301 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-e4471f33-70a8-45a1-80c6-51a14a0ecddc tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1081930766", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-635459421", "security_groups": [{"name": "tempest-secgroup-smoke-1916685125"}], "block_device_mapping_v2": [{"uuid": "b9396415-72fb-4680-9e94-75c749d98e4b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d895c0aa-bda4-4613-b99a-7874b7d4b4f0"}]}} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:29:07.027589 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.network.neutron [None req-e4471f33-70a8-45a1-80c6-51a14a0ecddc tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] validate_networks() for [('d895c0aa-bda4-4613-b99a-7874b7d4b4f0', None, None, None, None, None)] {{(pid=120580) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 01:29:07.434323 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-e4471f33-70a8-45a1-80c6-51a14a0ecddc tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Flavor limits 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 01:29:07.434755 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-e4471f33-70a8-45a1-80c6-51a14a0ecddc tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Image limits 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 01:29:07.435260 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-e4471f33-70a8-45a1-80c6-51a14a0ecddc tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Flavor pref 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 01:29:07.435674 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-e4471f33-70a8-45a1-80c6-51a14a0ecddc tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Image pref 0:0:0 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 01:29:07.436128 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.virt.hardware [None req-e4471f33-70a8-45a1-80c6-51a14a0ecddc tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 01:29:07.445403 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e4471f33-70a8-45a1-80c6-51a14a0ecddc tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:29:07.445885 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e4471f33-70a8-45a1-80c6-51a14a0ecddc tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:29:07.446319 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e4471f33-70a8-45a1-80c6-51a14a0ecddc tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:29:07.447042 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e4471f33-70a8-45a1-80c6-51a14a0ecddc tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:29:07.447497 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e4471f33-70a8-45a1-80c6-51a14a0ecddc tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:29:07.447964 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e4471f33-70a8-45a1-80c6-51a14a0ecddc tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:29:07.464449 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.quota [None req-e4471f33-70a8-45a1-80c6-51a14a0ecddc tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Getting quotas for project 333491050689469789d7fd61b4d70cf8. Resources: {'instances', 'ram', 'cores'} {{(pid=120580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 01:29:07.468335 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.quota [None req-e4471f33-70a8-45a1-80c6-51a14a0ecddc tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Getting quotas for user e58ada13a75445df97d8b6d1e3ea9c50 and project 333491050689469789d7fd61b4d70cf8. Resources: {'instances', 'ram', 'cores'} {{(pid=120580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 01:29:07.524905 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-e4471f33-70a8-45a1-80c6-51a14a0ecddc tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Going to run 1 instances... {{(pid=120580) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 01:29:07.527035 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-e4471f33-70a8-45a1-80c6-51a14a0ecddc tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 76c21471-f6b2-45c3-a420-4292686f5a48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b9396415-72fb-4680-9e94-75c749d98e4b',volume_size=None,volume_type=None)] {{(pid=120580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 01:29:07.655119 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-e4471f33-70a8-45a1-80c6-51a14a0ecddc tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.866691 Sep 06 01:29:07.655745 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 587/1140] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Sep 6 01:29:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 01:29:07.665873 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:29:07.666611 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:29:07.668451 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 01:29:07.668451 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Tue Sep 6 01:29:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/76c21471-f6b2-45c3-a420-4292686f5a48 (ip 10.222.0.23) !!! Sep 06 01:29:07.675258 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a24bb4e6-1e7f-4669-b0d7-cc2145e64f38 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:29:07.677091 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a24bb4e6-1e7f-4669-b0d7-cc2145e64f38 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 76c21471-f6b2-45c3-a420-4292686f5a48] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:29:07.789158 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-a24bb4e6-1e7f-4669-b0d7-cc2145e64f38 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:29:07.796644 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a24bb4e6-1e7f-4669-b0d7-cc2145e64f38 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/76c21471-f6b2-45c3-a420-4292686f5a48" status: 200 len: 1094 microversion: 2.1 time: 0.133338 Sep 06 01:29:07.797202 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 554/1141] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:29:07 2022] GET /compute/v2.1/servers/76c21471-f6b2-45c3-a420-4292686f5a48 => generated 1094 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:29:08.820357 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-6f56f302-4a20-457b-93bd-329730d1d1b9 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:29:08.820979 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-6f56f302-4a20-457b-93bd-329730d1d1b9 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 76c21471-f6b2-45c3-a420-4292686f5a48] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:29:08.827988 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6f56f302-4a20-457b-93bd-329730d1d1b9 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:29:08.828478 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6f56f302-4a20-457b-93bd-329730d1d1b9 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:29:08.828974 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6f56f302-4a20-457b-93bd-329730d1d1b9 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:29:08.829681 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6f56f302-4a20-457b-93bd-329730d1d1b9 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:29:08.830135 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6f56f302-4a20-457b-93bd-329730d1d1b9 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:29:08.830559 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6f56f302-4a20-457b-93bd-329730d1d1b9 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:29:08.893263 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-6f56f302-4a20-457b-93bd-329730d1d1b9 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:29:08.901478 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-6f56f302-4a20-457b-93bd-329730d1d1b9 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/76c21471-f6b2-45c3-a420-4292686f5a48" status: 200 len: 1210 microversion: 2.1 time: 0.085928 Sep 06 01:29:08.902036 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 588/1142] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:29:08 2022] GET /compute/v2.1/servers/76c21471-f6b2-45c3-a420-4292686f5a48 => generated 1210 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:29:09.925138 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-75a8b573-7756-46ad-8573-2ca68f0e6046 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:29:09.925788 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-75a8b573-7756-46ad-8573-2ca68f0e6046 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 76c21471-f6b2-45c3-a420-4292686f5a48] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:29:09.932716 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-75a8b573-7756-46ad-8573-2ca68f0e6046 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:29:09.933197 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-75a8b573-7756-46ad-8573-2ca68f0e6046 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:29:09.933629 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-75a8b573-7756-46ad-8573-2ca68f0e6046 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:29:09.934309 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-75a8b573-7756-46ad-8573-2ca68f0e6046 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:29:09.934757 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-75a8b573-7756-46ad-8573-2ca68f0e6046 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:29:09.935180 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-75a8b573-7756-46ad-8573-2ca68f0e6046 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:29:10.073366 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-75a8b573-7756-46ad-8573-2ca68f0e6046 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:29:10.081235 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-75a8b573-7756-46ad-8573-2ca68f0e6046 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/76c21471-f6b2-45c3-a420-4292686f5a48" status: 200 len: 1266 microversion: 2.1 time: 0.159987 Sep 06 01:29:10.081817 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 555/1143] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:29:09 2022] GET /compute/v2.1/servers/76c21471-f6b2-45c3-a420-4292686f5a48 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:29:10.296757 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [req-f9074747-87c2-41f6-8a60-21ae46a2f590 req-f97aa8dc-2c1e-43e2-9976-850bdf693b68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76c21471-f6b2-45c3-a420-4292686f5a48", "tag": "bbf20aed-23d7-4d77-92da-4dd4d20fb0a8"}]} {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:29:10.309148 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-f9074747-87c2-41f6-8a60-21ae46a2f590 req-f97aa8dc-2c1e-43e2-9976-850bdf693b68 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:29:10.309619 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-f9074747-87c2-41f6-8a60-21ae46a2f590 req-f97aa8dc-2c1e-43e2-9976-850bdf693b68 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:29:10.310267 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [req-f9074747-87c2-41f6-8a60-21ae46a2f590 req-f97aa8dc-2c1e-43e2-9976-850bdf693b68 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:29:10.322042 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.compute.server_external_events [req-f9074747-87c2-41f6-8a60-21ae46a2f590 req-f97aa8dc-2c1e-43e2-9976-850bdf693b68 service nova] Creating event network-changed:bbf20aed-23d7-4d77-92da-4dd4d20fb0a8 for instance 76c21471-f6b2-45c3-a420-4292686f5a48 on hv-cinder-84773 Sep 06 01:29:10.326966 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [req-f9074747-87c2-41f6-8a60-21ae46a2f590 req-f97aa8dc-2c1e-43e2-9976-850bdf693b68 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039223 Sep 06 01:29:10.327559 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 589/1144] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 01:29:11.104539 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-88d71fd7-d4d5-4236-be7f-6f9bc0cc7571 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:29:11.105286 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-88d71fd7-d4d5-4236-be7f-6f9bc0cc7571 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 76c21471-f6b2-45c3-a420-4292686f5a48] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:29:11.111692 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88d71fd7-d4d5-4236-be7f-6f9bc0cc7571 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:29:11.112202 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88d71fd7-d4d5-4236-be7f-6f9bc0cc7571 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:29:11.112637 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88d71fd7-d4d5-4236-be7f-6f9bc0cc7571 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:29:11.113325 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88d71fd7-d4d5-4236-be7f-6f9bc0cc7571 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:29:11.114300 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88d71fd7-d4d5-4236-be7f-6f9bc0cc7571 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:29:11.114725 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88d71fd7-d4d5-4236-be7f-6f9bc0cc7571 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:29:11.246106 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-88d71fd7-d4d5-4236-be7f-6f9bc0cc7571 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:29:11.253940 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-88d71fd7-d4d5-4236-be7f-6f9bc0cc7571 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/76c21471-f6b2-45c3-a420-4292686f5a48" status: 200 len: 1266 microversion: 2.1 time: 0.153245 Sep 06 01:29:11.255117 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 556/1145] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:29:11 2022] GET /compute/v2.1/servers/76c21471-f6b2-45c3-a420-4292686f5a48 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:29:12.277535 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-a67d7f7f-a421-48cb-ab91-8c839285c2f7 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:29:12.278236 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-a67d7f7f-a421-48cb-ab91-8c839285c2f7 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 76c21471-f6b2-45c3-a420-4292686f5a48] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:29:12.284304 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a67d7f7f-a421-48cb-ab91-8c839285c2f7 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:29:12.284805 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a67d7f7f-a421-48cb-ab91-8c839285c2f7 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:29:12.285236 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a67d7f7f-a421-48cb-ab91-8c839285c2f7 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:29:12.285923 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a67d7f7f-a421-48cb-ab91-8c839285c2f7 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:29:12.286360 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a67d7f7f-a421-48cb-ab91-8c839285c2f7 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:29:12.286777 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-a67d7f7f-a421-48cb-ab91-8c839285c2f7 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:29:12.421952 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-a67d7f7f-a421-48cb-ab91-8c839285c2f7 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:29:12.429550 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-a67d7f7f-a421-48cb-ab91-8c839285c2f7 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/76c21471-f6b2-45c3-a420-4292686f5a48" status: 200 len: 1266 microversion: 2.1 time: 0.156780 Sep 06 01:29:12.430106 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 590/1146] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:29:12 2022] GET /compute/v2.1/servers/76c21471-f6b2-45c3-a420-4292686f5a48 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:29:13.453277 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e0e30096-3db3-4a52-b7f1-13bbb537fe9a tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:29:13.453921 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e0e30096-3db3-4a52-b7f1-13bbb537fe9a tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 76c21471-f6b2-45c3-a420-4292686f5a48] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:29:13.460919 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e0e30096-3db3-4a52-b7f1-13bbb537fe9a tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:29:13.461402 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e0e30096-3db3-4a52-b7f1-13bbb537fe9a tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:29:13.461838 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e0e30096-3db3-4a52-b7f1-13bbb537fe9a tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:29:13.462531 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e0e30096-3db3-4a52-b7f1-13bbb537fe9a tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:29:13.462986 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e0e30096-3db3-4a52-b7f1-13bbb537fe9a tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:29:13.463409 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e0e30096-3db3-4a52-b7f1-13bbb537fe9a tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:29:13.591306 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-e0e30096-3db3-4a52-b7f1-13bbb537fe9a tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:29:13.599455 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e0e30096-3db3-4a52-b7f1-13bbb537fe9a tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/76c21471-f6b2-45c3-a420-4292686f5a48" status: 200 len: 1266 microversion: 2.1 time: 0.150085 Sep 06 01:29:13.600047 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 557/1147] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:29:13 2022] GET /compute/v2.1/servers/76c21471-f6b2-45c3-a420-4292686f5a48 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:29:14.620858 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-e6ee2d91-3f6f-4394-bcdc-2da7fc74fce1 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:29:14.621476 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-e6ee2d91-3f6f-4394-bcdc-2da7fc74fce1 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 76c21471-f6b2-45c3-a420-4292686f5a48] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:29:14.627465 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e6ee2d91-3f6f-4394-bcdc-2da7fc74fce1 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:29:14.627991 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e6ee2d91-3f6f-4394-bcdc-2da7fc74fce1 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:29:14.628433 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e6ee2d91-3f6f-4394-bcdc-2da7fc74fce1 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:29:14.629122 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e6ee2d91-3f6f-4394-bcdc-2da7fc74fce1 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:29:14.629574 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e6ee2d91-3f6f-4394-bcdc-2da7fc74fce1 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:29:14.629995 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-e6ee2d91-3f6f-4394-bcdc-2da7fc74fce1 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:29:14.755846 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-e6ee2d91-3f6f-4394-bcdc-2da7fc74fce1 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:29:14.763413 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-e6ee2d91-3f6f-4394-bcdc-2da7fc74fce1 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/76c21471-f6b2-45c3-a420-4292686f5a48" status: 200 len: 1266 microversion: 2.1 time: 0.146425 Sep 06 01:29:14.764040 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 591/1148] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:29:14 2022] GET /compute/v2.1/servers/76c21471-f6b2-45c3-a420-4292686f5a48 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:29:15.785775 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ec8e0783-4a9e-492b-a5ba-ce212131b3f1 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:29:15.786385 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ec8e0783-4a9e-492b-a5ba-ce212131b3f1 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 76c21471-f6b2-45c3-a420-4292686f5a48] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:29:15.793064 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec8e0783-4a9e-492b-a5ba-ce212131b3f1 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:29:15.793544 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec8e0783-4a9e-492b-a5ba-ce212131b3f1 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:29:15.793981 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec8e0783-4a9e-492b-a5ba-ce212131b3f1 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:29:15.794669 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec8e0783-4a9e-492b-a5ba-ce212131b3f1 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:29:15.795125 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec8e0783-4a9e-492b-a5ba-ce212131b3f1 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:29:15.795549 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec8e0783-4a9e-492b-a5ba-ce212131b3f1 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:29:15.924983 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-ec8e0783-4a9e-492b-a5ba-ce212131b3f1 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:29:15.933084 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ec8e0783-4a9e-492b-a5ba-ce212131b3f1 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/76c21471-f6b2-45c3-a420-4292686f5a48" status: 200 len: 1266 microversion: 2.1 time: 0.151206 Sep 06 01:29:15.933651 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 558/1149] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:29:15 2022] GET /compute/v2.1/servers/76c21471-f6b2-45c3-a420-4292686f5a48 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:29:16.955867 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-01a53868-42a5-4d8a-a694-c9639b5c7962 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:29:16.956478 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-01a53868-42a5-4d8a-a694-c9639b5c7962 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 76c21471-f6b2-45c3-a420-4292686f5a48] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:29:16.963455 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-01a53868-42a5-4d8a-a694-c9639b5c7962 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:29:16.963975 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-01a53868-42a5-4d8a-a694-c9639b5c7962 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:29:16.964408 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-01a53868-42a5-4d8a-a694-c9639b5c7962 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:29:16.965100 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-01a53868-42a5-4d8a-a694-c9639b5c7962 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:29:16.965551 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-01a53868-42a5-4d8a-a694-c9639b5c7962 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:29:16.965974 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-01a53868-42a5-4d8a-a694-c9639b5c7962 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:29:17.094985 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-01a53868-42a5-4d8a-a694-c9639b5c7962 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:29:17.102694 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-01a53868-42a5-4d8a-a694-c9639b5c7962 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/76c21471-f6b2-45c3-a420-4292686f5a48" status: 200 len: 1266 microversion: 2.1 time: 0.150701 Sep 06 01:29:17.103248 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 592/1150] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:29:16 2022] GET /compute/v2.1/servers/76c21471-f6b2-45c3-a420-4292686f5a48 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:29:18.125506 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4822157a-aa99-490d-9c4b-be5c48b1e3c9 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:29:18.126259 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4822157a-aa99-490d-9c4b-be5c48b1e3c9 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 76c21471-f6b2-45c3-a420-4292686f5a48] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:29:18.128638 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:29:18.134265 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4822157a-aa99-490d-9c4b-be5c48b1e3c9 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:29:18.134670 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4822157a-aa99-490d-9c4b-be5c48b1e3c9 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:29:18.135106 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4822157a-aa99-490d-9c4b-be5c48b1e3c9 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:29:18.135821 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4822157a-aa99-490d-9c4b-be5c48b1e3c9 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:29:18.136314 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4822157a-aa99-490d-9c4b-be5c48b1e3c9 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:29:18.136738 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4822157a-aa99-490d-9c4b-be5c48b1e3c9 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:29:18.269422 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-4822157a-aa99-490d-9c4b-be5c48b1e3c9 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:29:18.277671 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4822157a-aa99-490d-9c4b-be5c48b1e3c9 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/76c21471-f6b2-45c3-a420-4292686f5a48" status: 200 len: 1266 microversion: 2.1 time: 0.155994 Sep 06 01:29:18.278235 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 559/1151] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:29:18 2022] GET /compute/v2.1/servers/76c21471-f6b2-45c3-a420-4292686f5a48 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:29:19.300578 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-54864b29-9b66-4cf4-981d-8f0e342f195f tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:29:19.301749 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-54864b29-9b66-4cf4-981d-8f0e342f195f tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 76c21471-f6b2-45c3-a420-4292686f5a48] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:29:19.303699 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell0:SELECT=2 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:29:19.304434 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell0:SELECT=6 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:29:19.310434 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-54864b29-9b66-4cf4-981d-8f0e342f195f tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:29:19.310919 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-54864b29-9b66-4cf4-981d-8f0e342f195f tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:29:19.311357 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-54864b29-9b66-4cf4-981d-8f0e342f195f tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:29:19.312082 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-54864b29-9b66-4cf4-981d-8f0e342f195f tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:29:19.312832 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-54864b29-9b66-4cf4-981d-8f0e342f195f tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:29:19.312975 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-54864b29-9b66-4cf4-981d-8f0e342f195f tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:29:19.439318 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-54864b29-9b66-4cf4-981d-8f0e342f195f tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:29:19.446969 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-54864b29-9b66-4cf4-981d-8f0e342f195f tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/76c21471-f6b2-45c3-a420-4292686f5a48" status: 200 len: 1266 microversion: 2.1 time: 0.150307 Sep 06 01:29:19.447528 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 593/1152] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:29:19 2022] GET /compute/v2.1/servers/76c21471-f6b2-45c3-a420-4292686f5a48 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:29:19.868807 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-6adab167-fb70-4f70-89d9-996f2636696b req-bf895c6e-afb8-4c2d-886b-8531e2400ad5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76c21471-f6b2-45c3-a420-4292686f5a48", "name": "network-vif-plugged", "status": "completed", "tag": "bbf20aed-23d7-4d77-92da-4dd4d20fb0a8"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:29:19.881847 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-6adab167-fb70-4f70-89d9-996f2636696b req-bf895c6e-afb8-4c2d-886b-8531e2400ad5 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:29:19.882467 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-6adab167-fb70-4f70-89d9-996f2636696b req-bf895c6e-afb8-4c2d-886b-8531e2400ad5 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:29:19.883017 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-6adab167-fb70-4f70-89d9-996f2636696b req-bf895c6e-afb8-4c2d-886b-8531e2400ad5 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:29:19.894195 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-6adab167-fb70-4f70-89d9-996f2636696b req-bf895c6e-afb8-4c2d-886b-8531e2400ad5 service nova] Creating event network-vif-plugged:bbf20aed-23d7-4d77-92da-4dd4d20fb0a8 for instance 76c21471-f6b2-45c3-a420-4292686f5a48 on hv-cinder-84773 Sep 06 01:29:19.899803 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-6adab167-fb70-4f70-89d9-996f2636696b req-bf895c6e-afb8-4c2d-886b-8531e2400ad5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088321 Sep 06 01:29:19.900377 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 560/1153] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:29:20.469725 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-b3deeb47-0a6a-4f1e-bbef-ec1f16bd4add tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:29:20.470341 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-b3deeb47-0a6a-4f1e-bbef-ec1f16bd4add tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 76c21471-f6b2-45c3-a420-4292686f5a48] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:29:20.477258 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b3deeb47-0a6a-4f1e-bbef-ec1f16bd4add tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:29:20.477737 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b3deeb47-0a6a-4f1e-bbef-ec1f16bd4add tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:29:20.478172 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b3deeb47-0a6a-4f1e-bbef-ec1f16bd4add tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:29:20.478855 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b3deeb47-0a6a-4f1e-bbef-ec1f16bd4add tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:29:20.479304 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b3deeb47-0a6a-4f1e-bbef-ec1f16bd4add tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:29:20.479727 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-b3deeb47-0a6a-4f1e-bbef-ec1f16bd4add tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:29:20.606566 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-b3deeb47-0a6a-4f1e-bbef-ec1f16bd4add tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:29:20.614850 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-b3deeb47-0a6a-4f1e-bbef-ec1f16bd4add tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/76c21471-f6b2-45c3-a420-4292686f5a48" status: 200 len: 1266 microversion: 2.1 time: 0.149109 Sep 06 01:29:20.615407 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 594/1154] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:29:20 2022] GET /compute/v2.1/servers/76c21471-f6b2-45c3-a420-4292686f5a48 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:29:21.638226 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-66de12af-fb20-47f8-819f-4c89097b456a tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:29:21.638919 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-66de12af-fb20-47f8-819f-4c89097b456a tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 76c21471-f6b2-45c3-a420-4292686f5a48] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:29:21.645148 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-66de12af-fb20-47f8-819f-4c89097b456a tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:29:21.645620 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-66de12af-fb20-47f8-819f-4c89097b456a tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:29:21.646053 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-66de12af-fb20-47f8-819f-4c89097b456a tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:29:21.646729 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-66de12af-fb20-47f8-819f-4c89097b456a tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:29:21.647176 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-66de12af-fb20-47f8-819f-4c89097b456a tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:29:21.647594 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-66de12af-fb20-47f8-819f-4c89097b456a tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:29:21.785111 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-66de12af-fb20-47f8-819f-4c89097b456a tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:29:21.793058 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-66de12af-fb20-47f8-819f-4c89097b456a tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/76c21471-f6b2-45c3-a420-4292686f5a48" status: 200 len: 1454 microversion: 2.1 time: 0.159536 Sep 06 01:29:21.793617 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 561/1155] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:29:21 2022] GET /compute/v2.1/servers/76c21471-f6b2-45c3-a420-4292686f5a48 => generated 1454 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:29:21.814931 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-7bbf90af-5b48-4a9d-b305-0326b2a5fb48 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:29:21.815578 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-7bbf90af-5b48-4a9d-b305-0326b2a5fb48 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 76c21471-f6b2-45c3-a420-4292686f5a48] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:29:21.822536 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7bbf90af-5b48-4a9d-b305-0326b2a5fb48 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:29:21.823014 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7bbf90af-5b48-4a9d-b305-0326b2a5fb48 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:29:21.823449 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7bbf90af-5b48-4a9d-b305-0326b2a5fb48 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:29:21.824165 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7bbf90af-5b48-4a9d-b305-0326b2a5fb48 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:29:21.824616 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7bbf90af-5b48-4a9d-b305-0326b2a5fb48 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:29:21.825044 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-7bbf90af-5b48-4a9d-b305-0326b2a5fb48 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:29:21.955774 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-7bbf90af-5b48-4a9d-b305-0326b2a5fb48 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:29:21.963470 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-7bbf90af-5b48-4a9d-b305-0326b2a5fb48 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/76c21471-f6b2-45c3-a420-4292686f5a48" status: 200 len: 1454 microversion: 2.1 time: 0.152317 Sep 06 01:29:21.964265 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 595/1156] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:29:21 2022] GET /compute/v2.1/servers/76c21471-f6b2-45c3-a420-4292686f5a48 => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:29:23.788480 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-9e4cd5db-58c9-4068-9705-fb67c057e99c req-a37970d2-5fdf-42c6-8193-f7f1696d8591 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76c21471-f6b2-45c3-a420-4292686f5a48", "tag": "bbf20aed-23d7-4d77-92da-4dd4d20fb0a8"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:29:23.798317 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9e4cd5db-58c9-4068-9705-fb67c057e99c req-a37970d2-5fdf-42c6-8193-f7f1696d8591 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:29:23.798804 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9e4cd5db-58c9-4068-9705-fb67c057e99c req-a37970d2-5fdf-42c6-8193-f7f1696d8591 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:29:23.799238 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9e4cd5db-58c9-4068-9705-fb67c057e99c req-a37970d2-5fdf-42c6-8193-f7f1696d8591 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:29:23.810864 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-9e4cd5db-58c9-4068-9705-fb67c057e99c req-a37970d2-5fdf-42c6-8193-f7f1696d8591 service nova] Creating event network-changed:bbf20aed-23d7-4d77-92da-4dd4d20fb0a8 for instance 76c21471-f6b2-45c3-a420-4292686f5a48 on hv-cinder-84773 Sep 06 01:29:23.815838 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-9e4cd5db-58c9-4068-9705-fb67c057e99c req-a37970d2-5fdf-42c6-8193-f7f1696d8591 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085978 Sep 06 01:29:23.816509 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 562/1157] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:30:51.784726 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:30:51.789504 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=20 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:30:51.790236 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=40 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:30:51.791211 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 01:30:51.791362 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Tue Sep 6 01:30:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.23) !!! Sep 06 01:30:51.792768 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG dbcounter [-] [120580] Writing DB stats nova_cell1:SELECT=46 {{(pid=120580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 01:30:51.793816 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 01:30:51.793938 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Tue Sep 6 01:30:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/76c21471-f6b2-45c3-a420-4292686f5a48 (ip 10.222.0.23) !!! Sep 06 01:30:51.799004 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-6dcaf4c8-4ebc-4c4a-9446-37e24d88b23e tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:30:51.799496 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-6dcaf4c8-4ebc-4c4a-9446-37e24d88b23e tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 76c21471-f6b2-45c3-a420-4292686f5a48] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:30:51.810823 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-bc728d71-176f-4f43-8963-2740a39b38a7 req-ece3226f-d650-4859-8d1d-dd8b8b96db94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76c21471-f6b2-45c3-a420-4292686f5a48", "tag": "bbf20aed-23d7-4d77-92da-4dd4d20fb0a8"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:30:51.827348 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-bc728d71-176f-4f43-8963-2740a39b38a7 req-ece3226f-d650-4859-8d1d-dd8b8b96db94 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:30:51.828146 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6dcaf4c8-4ebc-4c4a-9446-37e24d88b23e tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:30:51.828672 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6dcaf4c8-4ebc-4c4a-9446-37e24d88b23e tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:30:51.829101 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6dcaf4c8-4ebc-4c4a-9446-37e24d88b23e tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:30:51.829814 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6dcaf4c8-4ebc-4c4a-9446-37e24d88b23e tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:30:51.830257 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6dcaf4c8-4ebc-4c4a-9446-37e24d88b23e tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:30:51.830679 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-6dcaf4c8-4ebc-4c4a-9446-37e24d88b23e tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:30:51.835921 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-bc728d71-176f-4f43-8963-2740a39b38a7 req-ece3226f-d650-4859-8d1d-dd8b8b96db94 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:30:51.836527 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-bc728d71-176f-4f43-8963-2740a39b38a7 req-ece3226f-d650-4859-8d1d-dd8b8b96db94 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:30:51.852062 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-bc728d71-176f-4f43-8963-2740a39b38a7 req-ece3226f-d650-4859-8d1d-dd8b8b96db94 service nova] Creating event network-changed:bbf20aed-23d7-4d77-92da-4dd4d20fb0a8 for instance 76c21471-f6b2-45c3-a420-4292686f5a48 on hv-cinder-84773 Sep 06 01:30:51.857084 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-bc728d71-176f-4f43-8963-2740a39b38a7 req-ece3226f-d650-4859-8d1d-dd8b8b96db94 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070405 Sep 06 01:30:51.857738 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 563/1158] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:30:51.860864 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-6dcaf4c8-4ebc-4c4a-9446-37e24d88b23e tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 76c21471-f6b2-45c3-a420-4292686f5a48] Going to try to terminate instance {{(pid=120580) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 01:30:51.946349 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-6dcaf4c8-4ebc-4c4a-9446-37e24d88b23e tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "DELETE /compute/v2.1/servers/76c21471-f6b2-45c3-a420-4292686f5a48" status: 204 len: 0 microversion: 2.1 time: 0.163202 Sep 06 01:30:51.950265 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 596/1159] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 6 01:30:51 2022] DELETE /compute/v2.1/servers/76c21471-f6b2-45c3-a420-4292686f5a48 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 01:30:51.957071 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7c65c8a8-0882-4a8f-8c0b-7e9fa8e18cf3 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:30:51.957860 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7c65c8a8-0882-4a8f-8c0b-7e9fa8e18cf3 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 76c21471-f6b2-45c3-a420-4292686f5a48] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:30:51.966080 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c65c8a8-0882-4a8f-8c0b-7e9fa8e18cf3 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:30:51.966569 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c65c8a8-0882-4a8f-8c0b-7e9fa8e18cf3 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:30:51.967004 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c65c8a8-0882-4a8f-8c0b-7e9fa8e18cf3 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:30:51.967705 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c65c8a8-0882-4a8f-8c0b-7e9fa8e18cf3 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:30:51.968191 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c65c8a8-0882-4a8f-8c0b-7e9fa8e18cf3 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:30:51.968645 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c65c8a8-0882-4a8f-8c0b-7e9fa8e18cf3 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:30:52.110586 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-7c65c8a8-0882-4a8f-8c0b-7e9fa8e18cf3 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:30:52.118388 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7c65c8a8-0882-4a8f-8c0b-7e9fa8e18cf3 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/76c21471-f6b2-45c3-a420-4292686f5a48" status: 200 len: 1579 microversion: 2.1 time: 0.166641 Sep 06 01:30:52.118952 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 564/1160] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:30:51 2022] GET /compute/v2.1/servers/76c21471-f6b2-45c3-a420-4292686f5a48 => generated 1579 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 01:30:53.142478 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-74b3fa90-029f-4acb-8fcb-f51867382b6f tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:30:53.143181 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-74b3fa90-029f-4acb-8fcb-f51867382b6f tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 76c21471-f6b2-45c3-a420-4292686f5a48] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:30:53.149590 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-74b3fa90-029f-4acb-8fcb-f51867382b6f tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:30:53.150070 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-74b3fa90-029f-4acb-8fcb-f51867382b6f tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:30:53.150502 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-74b3fa90-029f-4acb-8fcb-f51867382b6f tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:30:53.151184 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-74b3fa90-029f-4acb-8fcb-f51867382b6f tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:30:53.151629 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-74b3fa90-029f-4acb-8fcb-f51867382b6f tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:30:53.152080 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-74b3fa90-029f-4acb-8fcb-f51867382b6f tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:30:53.286493 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-74b3fa90-029f-4acb-8fcb-f51867382b6f tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:30:53.295137 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-74b3fa90-029f-4acb-8fcb-f51867382b6f tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/76c21471-f6b2-45c3-a420-4292686f5a48" status: 200 len: 1579 microversion: 2.1 time: 0.156892 Sep 06 01:30:53.295706 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 597/1161] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:30:53 2022] GET /compute/v2.1/servers/76c21471-f6b2-45c3-a420-4292686f5a48 => generated 1579 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:30:54.079248 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-5e67b9ee-cb6f-4127-ae9e-0c7f1527a9c5 req-0e862a9e-83d2-4721-80db-70ea71c20a2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76c21471-f6b2-45c3-a420-4292686f5a48", "name": "network-vif-deleted", "tag": "bbf20aed-23d7-4d77-92da-4dd4d20fb0a8"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:30:54.089158 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-5e67b9ee-cb6f-4127-ae9e-0c7f1527a9c5 req-0e862a9e-83d2-4721-80db-70ea71c20a2a service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:30:54.089633 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-5e67b9ee-cb6f-4127-ae9e-0c7f1527a9c5 req-0e862a9e-83d2-4721-80db-70ea71c20a2a service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:30:54.090064 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-5e67b9ee-cb6f-4127-ae9e-0c7f1527a9c5 req-0e862a9e-83d2-4721-80db-70ea71c20a2a service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:30:54.100686 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-5e67b9ee-cb6f-4127-ae9e-0c7f1527a9c5 req-0e862a9e-83d2-4721-80db-70ea71c20a2a service nova] Creating event network-vif-deleted:bbf20aed-23d7-4d77-92da-4dd4d20fb0a8 for instance 76c21471-f6b2-45c3-a420-4292686f5a48 on hv-cinder-84773 Sep 06 01:30:54.105392 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-5e67b9ee-cb6f-4127-ae9e-0c7f1527a9c5 req-0e862a9e-83d2-4721-80db-70ea71c20a2a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128798 Sep 06 01:30:54.106016 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 565/1162] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 01:30:54.318524 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-16ae153a-74ef-4850-8b9f-59480ef16e84 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:30:54.319705 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-16ae153a-74ef-4850-8b9f-59480ef16e84 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 76c21471-f6b2-45c3-a420-4292686f5a48] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:30:54.326470 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-16ae153a-74ef-4850-8b9f-59480ef16e84 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:30:54.326954 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-16ae153a-74ef-4850-8b9f-59480ef16e84 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:30:54.327385 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-16ae153a-74ef-4850-8b9f-59480ef16e84 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:30:54.328176 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-16ae153a-74ef-4850-8b9f-59480ef16e84 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:30:54.328624 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-16ae153a-74ef-4850-8b9f-59480ef16e84 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:30:54.329042 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-16ae153a-74ef-4850-8b9f-59480ef16e84 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:30:54.360846 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-16ae153a-74ef-4850-8b9f-59480ef16e84 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:30:54.361328 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-16ae153a-74ef-4850-8b9f-59480ef16e84 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:30:54.361757 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-16ae153a-74ef-4850-8b9f-59480ef16e84 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:30:54.362198 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.objects.instance [None req-16ae153a-74ef-4850-8b9f-59480ef16e84 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lazy-loading 'fault' on Instance uuid 76c21471-f6b2-45c3-a420-4292686f5a48 {{(pid=120580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 01:30:54.403454 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-16ae153a-74ef-4850-8b9f-59480ef16e84 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:30:54.411099 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-16ae153a-74ef-4850-8b9f-59480ef16e84 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/76c21471-f6b2-45c3-a420-4292686f5a48" status: 200 len: 1230 microversion: 2.1 time: 0.096457 Sep 06 01:30:54.411658 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 598/1163] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:30:54 2022] GET /compute/v2.1/servers/76c21471-f6b2-45c3-a420-4292686f5a48 => generated 1230 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:30:55.435244 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-74d54220-1af0-45ec-9502-8675d6e224d5 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:30:55.435999 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-74d54220-1af0-45ec-9502-8675d6e224d5 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 76c21471-f6b2-45c3-a420-4292686f5a48] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:30:55.442068 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74d54220-1af0-45ec-9502-8675d6e224d5 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:30:55.442545 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74d54220-1af0-45ec-9502-8675d6e224d5 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:30:55.442977 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74d54220-1af0-45ec-9502-8675d6e224d5 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:30:55.443662 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74d54220-1af0-45ec-9502-8675d6e224d5 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:30:55.444631 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74d54220-1af0-45ec-9502-8675d6e224d5 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:30:55.445045 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74d54220-1af0-45ec-9502-8675d6e224d5 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:30:55.457845 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-74d54220-1af0-45ec-9502-8675d6e224d5 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] HTTP exception thrown: Instance 76c21471-f6b2-45c3-a420-4292686f5a48 could not be found. Sep 06 01:30:55.459460 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-74d54220-1af0-45ec-9502-8675d6e224d5 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Request method failure captured: Sep 06 01:30:55.459460 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/76c21471-f6b2-45c3-a420-4292686f5a48 HTTP/1.1 Sep 06 01:30:55.459460 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept: application/json Sep 06 01:30:55.459460 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept-Encoding: identity Sep 06 01:30:55.459460 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Connection: close Sep 06 01:30:55.459460 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Length: 0 Sep 06 01:30:55.459460 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Type: application/json Sep 06 01:30:55.459460 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Host: 10.222.0.23 Sep 06 01:30:55.459460 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Openstack-System-Scope: None Sep 06 01:30:55.459460 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Sep 06 01:30:55.459460 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjFqFUGRDtvP7kikq2u8OKAD3gLCAs2_SwVmWbc8V_RHR4nErzGcYvrFO-vyEdydLblKWwtXYvBtV3tVFqW3EWpy0-YMqKEle_KOqqbvCYoqVcEFz7Ca6sjNfy9srnZpYUdiZQr9y5YBjT5yBVEwBW_DIZ2zYbvapfTljIQhHgx6cpMkQ Sep 06 01:30:55.459460 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Id: None Sep 06 01:30:55.459460 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Name: None Sep 06 01:30:55.459460 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Identity-Status: Confirmed Sep 06 01:30:55.459460 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Is-Admin-Project: True Sep 06 01:30:55.459460 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Id: default Sep 06 01:30:55.459460 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Name: Default Sep 06 01:30:55.459460 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Id: 333491050689469789d7fd61b4d70cf8 Sep 06 01:30:55.459460 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Name: tempest-TestVolumeBootPattern-2054739329 Sep 06 01:30:55.459460 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Role: reader,member Sep 06 01:30:55.459460 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Roles: reader,member Sep 06 01:30:55.461877 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/333491050689469789d7fd61b4d70cf8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/333491050689469789d7fd61b4d70cf8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_333491050689469789d7fd61b4d70cf8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/333491050689469789d7fd61b4d70cf8"}]}] Sep 06 01:30:55.461877 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant: tempest-TestVolumeBootPattern-2054739329 Sep 06 01:30:55.461877 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Id: 333491050689469789d7fd61b4d70cf8 Sep 06 01:30:55.461877 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Name: tempest-TestVolumeBootPattern-2054739329 Sep 06 01:30:55.461877 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User: tempest-TestVolumeBootPattern-2054739329-project Sep 06 01:30:55.461877 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Id: default Sep 06 01:30:55.461877 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Name: Default Sep 06 01:30:55.461877 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Id: e58ada13a75445df97d8b6d1e3ea9c50 Sep 06 01:30:55.461877 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Name: tempest-TestVolumeBootPattern-2054739329-project Sep 06 01:30:55.461877 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: method: > Sep 06 01:30:55.461877 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: exception: Instance 76c21471-f6b2-45c3-a420-4292686f5a48 could not be found. Sep 06 01:30:55.461877 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: action_args: {'id': '76c21471-f6b2-45c3-a420-4292686f5a48'} Sep 06 01:30:55.462863 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:30:55.462863 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:30:55.462863 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 01:30:55.462863 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 01:30:55.462863 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 01:30:55.462863 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 01:30:55.462863 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 01:30:55.462863 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 01:30:55.462863 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 01:30:55.462863 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 01:30:55.462863 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76c21471-f6b2-45c3-a420-4292686f5a48 could not be found. Sep 06 01:30:55.462863 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:30:55.462863 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:30:55.462863 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:30:55.462863 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:30:55.462863 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:30:55.462863 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:30:55.462863 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:30:55.462863 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:30:55.462863 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:30:55.464542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:30:55.464542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 01:30:55.464542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 01:30:55.464542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 01:30:55.464542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 01:30:55.464542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 01:30:55.464542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:30:55.464542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76c21471-f6b2-45c3-a420-4292686f5a48 could not be found. Sep 06 01:30:55.464542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:30:55.464542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:30:55.464542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:30:55.464542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:30:55.464542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:30:55.464542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:30:55.464542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:30:55.464542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:30:55.464542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76c21471-f6b2-45c3-a420-4292686f5a48 could not be found. Sep 06 01:30:55.464542 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:30:55.466131 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-74d54220-1af0-45ec-9502-8675d6e224d5 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Returning 404 to user: Instance 76c21471-f6b2-45c3-a420-4292686f5a48 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:30:55.466131 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-74d54220-1af0-45ec-9502-8675d6e224d5 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/76c21471-f6b2-45c3-a420-4292686f5a48" status: 404 len: 111 microversion: 2.1 time: 0.030812 Sep 06 01:30:55.466131 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 566/1164] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:30:55 2022] GET /compute/v2.1/servers/76c21471-f6b2-45c3-a420-4292686f5a48 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 01:30:58.508679 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-ed43465d-1784-4c51-9335-878a83a0e03c req-c9d4cffe-e7c3-4f16-8310-a6611553ecb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3812b0ec-ef45-4539-9ef6-30e67af033a8", "tag": "81d888f2-b5fe-4da9-9989-96d303763c2a"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:30:58.517821 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-249b68a6-8b23-4d64-ac4f-48936d25a2e9 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:30:58.518312 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-249b68a6-8b23-4d64-ac4f-48936d25a2e9 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 3812b0ec-ef45-4539-9ef6-30e67af033a8] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:30:58.519148 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ed43465d-1784-4c51-9335-878a83a0e03c req-c9d4cffe-e7c3-4f16-8310-a6611553ecb0 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:30:58.519766 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ed43465d-1784-4c51-9335-878a83a0e03c req-c9d4cffe-e7c3-4f16-8310-a6611553ecb0 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:30:58.520399 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ed43465d-1784-4c51-9335-878a83a0e03c req-c9d4cffe-e7c3-4f16-8310-a6611553ecb0 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:30:58.525302 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-249b68a6-8b23-4d64-ac4f-48936d25a2e9 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:30:58.525788 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-249b68a6-8b23-4d64-ac4f-48936d25a2e9 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:30:58.526217 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-249b68a6-8b23-4d64-ac4f-48936d25a2e9 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:30:58.526906 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-249b68a6-8b23-4d64-ac4f-48936d25a2e9 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:30:58.527351 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-249b68a6-8b23-4d64-ac4f-48936d25a2e9 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:30:58.527988 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-249b68a6-8b23-4d64-ac4f-48936d25a2e9 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:30:58.532681 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-ed43465d-1784-4c51-9335-878a83a0e03c req-c9d4cffe-e7c3-4f16-8310-a6611553ecb0 service nova] Creating event network-changed:81d888f2-b5fe-4da9-9989-96d303763c2a for instance 3812b0ec-ef45-4539-9ef6-30e67af033a8 on hv-cinder-84773 Sep 06 01:30:58.538080 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-ed43465d-1784-4c51-9335-878a83a0e03c req-c9d4cffe-e7c3-4f16-8310-a6611553ecb0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033400 Sep 06 01:30:58.539237 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 567/1165] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:30:58.553867 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-249b68a6-8b23-4d64-ac4f-48936d25a2e9 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 3812b0ec-ef45-4539-9ef6-30e67af033a8] Going to try to terminate instance {{(pid=120580) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 01:30:58.658371 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-249b68a6-8b23-4d64-ac4f-48936d25a2e9 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3812b0ec-ef45-4539-9ef6-30e67af033a8" status: 204 len: 0 microversion: 2.1 time: 0.155858 Sep 06 01:30:58.659187 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 599/1166] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 6 01:30:58 2022] DELETE /compute/v2.1/servers/3812b0ec-ef45-4539-9ef6-30e67af033a8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 01:30:58.668615 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9bc44a4a-7f93-428a-b410-0a8f9cabc180 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:30:58.669705 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9bc44a4a-7f93-428a-b410-0a8f9cabc180 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 3812b0ec-ef45-4539-9ef6-30e67af033a8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:30:58.677942 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9bc44a4a-7f93-428a-b410-0a8f9cabc180 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:30:58.679439 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9bc44a4a-7f93-428a-b410-0a8f9cabc180 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:30:58.680206 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9bc44a4a-7f93-428a-b410-0a8f9cabc180 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:30:58.681199 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9bc44a4a-7f93-428a-b410-0a8f9cabc180 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:30:58.681865 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9bc44a4a-7f93-428a-b410-0a8f9cabc180 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:30:58.682545 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9bc44a4a-7f93-428a-b410-0a8f9cabc180 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:30:58.822999 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.policy [None req-9bc44a4a-7f93-428a-b410-0a8f9cabc180 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:30:58.830699 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9bc44a4a-7f93-428a-b410-0a8f9cabc180 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/3812b0ec-ef45-4539-9ef6-30e67af033a8" status: 200 len: 1577 microversion: 2.1 time: 0.166986 Sep 06 01:30:58.831258 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 568/1167] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:30:58 2022] GET /compute/v2.1/servers/3812b0ec-ef45-4539-9ef6-30e67af033a8 => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:30:59.854890 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-39b0246a-7bd7-49e7-b6bd-6c6ead460d88 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:30:59.855545 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-39b0246a-7bd7-49e7-b6bd-6c6ead460d88 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 3812b0ec-ef45-4539-9ef6-30e67af033a8] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:30:59.861880 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-39b0246a-7bd7-49e7-b6bd-6c6ead460d88 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:30:59.862358 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-39b0246a-7bd7-49e7-b6bd-6c6ead460d88 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:30:59.862791 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-39b0246a-7bd7-49e7-b6bd-6c6ead460d88 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:30:59.863475 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-39b0246a-7bd7-49e7-b6bd-6c6ead460d88 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:30:59.863952 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-39b0246a-7bd7-49e7-b6bd-6c6ead460d88 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:30:59.864377 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-39b0246a-7bd7-49e7-b6bd-6c6ead460d88 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:30:59.995450 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-39b0246a-7bd7-49e7-b6bd-6c6ead460d88 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:31:00.003443 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-39b0246a-7bd7-49e7-b6bd-6c6ead460d88 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/3812b0ec-ef45-4539-9ef6-30e67af033a8" status: 200 len: 1577 microversion: 2.1 time: 0.152890 Sep 06 01:31:00.004257 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 600/1168] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:30:59 2022] GET /compute/v2.1/servers/3812b0ec-ef45-4539-9ef6-30e67af033a8 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:31:00.548366 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-9d17ca52-eef6-426a-8be0-f183b507a93b req-0b2796eb-8f03-4251-b26f-90bb8127a400 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3812b0ec-ef45-4539-9ef6-30e67af033a8", "name": "network-vif-deleted", "tag": "81d888f2-b5fe-4da9-9989-96d303763c2a"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 01:31:00.559706 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9d17ca52-eef6-426a-8be0-f183b507a93b req-0b2796eb-8f03-4251-b26f-90bb8127a400 service nova] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:31:00.560238 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9d17ca52-eef6-426a-8be0-f183b507a93b req-0b2796eb-8f03-4251-b26f-90bb8127a400 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:31:00.560657 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9d17ca52-eef6-426a-8be0-f183b507a93b req-0b2796eb-8f03-4251-b26f-90bb8127a400 service nova] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:31:00.572370 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-9d17ca52-eef6-426a-8be0-f183b507a93b req-0b2796eb-8f03-4251-b26f-90bb8127a400 service nova] Creating event network-vif-deleted:81d888f2-b5fe-4da9-9989-96d303763c2a for instance 3812b0ec-ef45-4539-9ef6-30e67af033a8 on hv-cinder-84773 Sep 06 01:31:00.577476 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-9d17ca52-eef6-426a-8be0-f183b507a93b req-0b2796eb-8f03-4251-b26f-90bb8127a400 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032997 Sep 06 01:31:00.578318 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 569/1169] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 6 01:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 01:31:01.028897 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-c4cbd0de-cfa5-4726-954e-57c2e55a3093 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:31:01.029449 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-c4cbd0de-cfa5-4726-954e-57c2e55a3093 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 3812b0ec-ef45-4539-9ef6-30e67af033a8] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:31:01.035832 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c4cbd0de-cfa5-4726-954e-57c2e55a3093 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:31:01.036317 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c4cbd0de-cfa5-4726-954e-57c2e55a3093 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:31:01.036756 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c4cbd0de-cfa5-4726-954e-57c2e55a3093 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:31:01.038060 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c4cbd0de-cfa5-4726-954e-57c2e55a3093 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:31:01.038531 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c4cbd0de-cfa5-4726-954e-57c2e55a3093 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:31:01.039220 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c4cbd0de-cfa5-4726-954e-57c2e55a3093 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:31:01.071414 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c4cbd0de-cfa5-4726-954e-57c2e55a3093 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:31:01.072043 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c4cbd0de-cfa5-4726-954e-57c2e55a3093 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:31:01.072381 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-c4cbd0de-cfa5-4726-954e-57c2e55a3093 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:31:01.072784 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.objects.instance [None req-c4cbd0de-cfa5-4726-954e-57c2e55a3093 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lazy-loading 'fault' on Instance uuid 3812b0ec-ef45-4539-9ef6-30e67af033a8 {{(pid=120580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 01:31:01.113013 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.policy [None req-c4cbd0de-cfa5-4726-954e-57c2e55a3093 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58ada13a75445df97d8b6d1e3ea9c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333491050689469789d7fd61b4d70cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120580) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 01:31:01.123075 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-c4cbd0de-cfa5-4726-954e-57c2e55a3093 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/3812b0ec-ef45-4539-9ef6-30e67af033a8" status: 200 len: 1229 microversion: 2.1 time: 0.097988 Sep 06 01:31:01.123692 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 601/1170] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:31:01 2022] GET /compute/v2.1/servers/3812b0ec-ef45-4539-9ef6-30e67af033a8 => generated 1229 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 01:31:02.147287 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a7bfd0dd-f65a-4028-b26a-40049e1a765b tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:31:02.148045 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a7bfd0dd-f65a-4028-b26a-40049e1a765b tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 3812b0ec-ef45-4539-9ef6-30e67af033a8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:31:02.154907 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a7bfd0dd-f65a-4028-b26a-40049e1a765b tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:31:02.155404 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a7bfd0dd-f65a-4028-b26a-40049e1a765b tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:31:02.156286 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a7bfd0dd-f65a-4028-b26a-40049e1a765b tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:31:02.156986 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a7bfd0dd-f65a-4028-b26a-40049e1a765b tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:31:02.157445 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a7bfd0dd-f65a-4028-b26a-40049e1a765b tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:31:02.157869 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a7bfd0dd-f65a-4028-b26a-40049e1a765b tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:31:02.172251 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-a7bfd0dd-f65a-4028-b26a-40049e1a765b tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] HTTP exception thrown: Instance 3812b0ec-ef45-4539-9ef6-30e67af033a8 could not be found. Sep 06 01:31:02.173994 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a7bfd0dd-f65a-4028-b26a-40049e1a765b tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Request method failure captured: Sep 06 01:31:02.173994 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/3812b0ec-ef45-4539-9ef6-30e67af033a8 HTTP/1.1 Sep 06 01:31:02.173994 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept: application/json Sep 06 01:31:02.173994 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept-Encoding: identity Sep 06 01:31:02.173994 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Connection: close Sep 06 01:31:02.173994 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Length: 0 Sep 06 01:31:02.173994 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Type: application/json Sep 06 01:31:02.173994 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Host: 10.222.0.23 Sep 06 01:31:02.173994 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Openstack-System-Scope: None Sep 06 01:31:02.173994 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Sep 06 01:31:02.173994 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjFqFUGRDtvP7kikq2u8OKAD3gLCAs2_SwVmWbc8V_RHR4nErzGcYvrFO-vyEdydLblKWwtXYvBtV3tVFqW3EWpy0-YMqKEle_KOqqbvCYoqVcEFz7Ca6sjNfy9srnZpYUdiZQr9y5YBjT5yBVEwBW_DIZ2zYbvapfTljIQhHgx6cpMkQ Sep 06 01:31:02.173994 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Id: None Sep 06 01:31:02.173994 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Name: None Sep 06 01:31:02.173994 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Identity-Status: Confirmed Sep 06 01:31:02.173994 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Is-Admin-Project: True Sep 06 01:31:02.173994 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Id: default Sep 06 01:31:02.173994 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Name: Default Sep 06 01:31:02.173994 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Id: 333491050689469789d7fd61b4d70cf8 Sep 06 01:31:02.173994 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Name: tempest-TestVolumeBootPattern-2054739329 Sep 06 01:31:02.173994 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Role: reader,member Sep 06 01:31:02.173994 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Roles: reader,member Sep 06 01:31:02.175630 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/333491050689469789d7fd61b4d70cf8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/333491050689469789d7fd61b4d70cf8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_333491050689469789d7fd61b4d70cf8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/333491050689469789d7fd61b4d70cf8"}]}] Sep 06 01:31:02.175630 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant: tempest-TestVolumeBootPattern-2054739329 Sep 06 01:31:02.175630 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Id: 333491050689469789d7fd61b4d70cf8 Sep 06 01:31:02.175630 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Name: tempest-TestVolumeBootPattern-2054739329 Sep 06 01:31:02.175630 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User: tempest-TestVolumeBootPattern-2054739329-project Sep 06 01:31:02.175630 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Id: default Sep 06 01:31:02.175630 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Name: Default Sep 06 01:31:02.175630 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Id: e58ada13a75445df97d8b6d1e3ea9c50 Sep 06 01:31:02.175630 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Name: tempest-TestVolumeBootPattern-2054739329-project Sep 06 01:31:02.175630 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: method: > Sep 06 01:31:02.175630 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: exception: Instance 3812b0ec-ef45-4539-9ef6-30e67af033a8 could not be found. Sep 06 01:31:02.175630 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: action_args: {'id': '3812b0ec-ef45-4539-9ef6-30e67af033a8'} Sep 06 01:31:02.176747 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:31:02.176747 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:31:02.176747 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 01:31:02.176747 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 01:31:02.176747 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 01:31:02.176747 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 01:31:02.176747 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 01:31:02.176747 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 01:31:02.176747 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 01:31:02.176747 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 01:31:02.176747 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3812b0ec-ef45-4539-9ef6-30e67af033a8 could not be found. Sep 06 01:31:02.176747 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:31:02.176747 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:31:02.176747 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:31:02.176747 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:31:02.176747 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:31:02.176747 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:31:02.176747 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:31:02.176747 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:31:02.176747 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:31:02.178736 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:31:02.178736 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 01:31:02.178736 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 01:31:02.178736 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 01:31:02.178736 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 01:31:02.178736 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 01:31:02.178736 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:31:02.178736 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3812b0ec-ef45-4539-9ef6-30e67af033a8 could not be found. Sep 06 01:31:02.178736 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:31:02.178736 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:31:02.178736 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:31:02.178736 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:31:02.178736 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:31:02.178736 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:31:02.178736 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:31:02.178736 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:31:02.178736 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3812b0ec-ef45-4539-9ef6-30e67af033a8 could not be found. Sep 06 01:31:02.178736 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:31:02.180273 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a7bfd0dd-f65a-4028-b26a-40049e1a765b tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Returning 404 to user: Instance 3812b0ec-ef45-4539-9ef6-30e67af033a8 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:31:02.180273 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a7bfd0dd-f65a-4028-b26a-40049e1a765b tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/3812b0ec-ef45-4539-9ef6-30e67af033a8" status: 404 len: 111 microversion: 2.1 time: 0.033023 Sep 06 01:31:02.180273 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 570/1171] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:31:02 2022] GET /compute/v2.1/servers/3812b0ec-ef45-4539-9ef6-30e67af033a8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 01:31:02.603676 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-40982487-7027-4b89-9ddf-1f20106a1578 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:31:02.604213 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.compute.api [None req-40982487-7027-4b89-9ddf-1f20106a1578 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 062259ef-5e29-4726-b12f-fde66240b80d] Fetching instance by UUID {{(pid=120580) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:31:02.610622 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-40982487-7027-4b89-9ddf-1f20106a1578 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:31:02.611099 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-40982487-7027-4b89-9ddf-1f20106a1578 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:31:02.611534 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-40982487-7027-4b89-9ddf-1f20106a1578 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:31:02.612248 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-40982487-7027-4b89-9ddf-1f20106a1578 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:31:02.612700 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-40982487-7027-4b89-9ddf-1f20106a1578 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:31:02.613119 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG oslo_concurrency.lockutils [None req-40982487-7027-4b89-9ddf-1f20106a1578 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:31:02.626327 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.wsgi [None req-40982487-7027-4b89-9ddf-1f20106a1578 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] HTTP exception thrown: Instance 062259ef-5e29-4726-b12f-fde66240b80d could not be found. Sep 06 01:31:02.627975 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-40982487-7027-4b89-9ddf-1f20106a1578 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Request method failure captured: Sep 06 01:31:02.627975 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: request: DELETE /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d HTTP/1.1 Sep 06 01:31:02.627975 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept: application/json Sep 06 01:31:02.627975 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Accept-Encoding: identity Sep 06 01:31:02.627975 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Connection: close Sep 06 01:31:02.627975 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Length: 0 Sep 06 01:31:02.627975 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Content-Type: application/json Sep 06 01:31:02.627975 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Host: 10.222.0.23 Sep 06 01:31:02.627975 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: Openstack-System-Scope: None Sep 06 01:31:02.627975 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: User-Agent: python-urllib3/1.26.12 Sep 06 01:31:02.627975 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Auth-Token: gAAAAABjFqFUGRDtvP7kikq2u8OKAD3gLCAs2_SwVmWbc8V_RHR4nErzGcYvrFO-vyEdydLblKWwtXYvBtV3tVFqW3EWpy0-YMqKEle_KOqqbvCYoqVcEFz7Ca6sjNfy9srnZpYUdiZQr9y5YBjT5yBVEwBW_DIZ2zYbvapfTljIQhHgx6cpMkQ Sep 06 01:31:02.627975 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Id: None Sep 06 01:31:02.627975 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Domain-Name: None Sep 06 01:31:02.627975 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Identity-Status: Confirmed Sep 06 01:31:02.627975 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Is-Admin-Project: True Sep 06 01:31:02.627975 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Id: default Sep 06 01:31:02.627975 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Domain-Name: Default Sep 06 01:31:02.627975 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Id: 333491050689469789d7fd61b4d70cf8 Sep 06 01:31:02.627975 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Project-Name: tempest-TestVolumeBootPattern-2054739329 Sep 06 01:31:02.627975 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Role: reader,member Sep 06 01:31:02.627975 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Roles: reader,member Sep 06 01:31:02.629660 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/333491050689469789d7fd61b4d70cf8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/333491050689469789d7fd61b4d70cf8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_333491050689469789d7fd61b4d70cf8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/333491050689469789d7fd61b4d70cf8"}]}] Sep 06 01:31:02.629660 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant: tempest-TestVolumeBootPattern-2054739329 Sep 06 01:31:02.629660 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Id: 333491050689469789d7fd61b4d70cf8 Sep 06 01:31:02.629660 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-Tenant-Name: tempest-TestVolumeBootPattern-2054739329 Sep 06 01:31:02.629660 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User: tempest-TestVolumeBootPattern-2054739329-project Sep 06 01:31:02.629660 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Id: default Sep 06 01:31:02.629660 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Domain-Name: Default Sep 06 01:31:02.629660 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Id: e58ada13a75445df97d8b6d1e3ea9c50 Sep 06 01:31:02.629660 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: X-User-Name: tempest-TestVolumeBootPattern-2054739329-project Sep 06 01:31:02.629660 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: method: > Sep 06 01:31:02.629660 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: exception: Instance 062259ef-5e29-4726-b12f-fde66240b80d could not be found. Sep 06 01:31:02.629660 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: action_args: {'id': '062259ef-5e29-4726-b12f-fde66240b80d'} Sep 06 01:31:02.630789 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:31:02.630789 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:31:02.630789 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 01:31:02.630789 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 01:31:02.630789 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 01:31:02.630789 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 01:31:02.630789 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 01:31:02.630789 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 01:31:02.630789 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 01:31:02.630789 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 01:31:02.630789 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 062259ef-5e29-4726-b12f-fde66240b80d could not be found. Sep 06 01:31:02.630789 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:31:02.630789 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:31:02.630789 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:31:02.630789 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:31:02.630789 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:31:02.630789 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:31:02.630789 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:31:02.630789 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:31:02.630789 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:31:02.632455 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:31:02.632455 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 01:31:02.632455 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 01:31:02.632455 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 01:31:02.632455 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 01:31:02.632455 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 01:31:02.632455 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 01:31:02.632455 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 01:31:02.632455 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:31:02.632455 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 062259ef-5e29-4726-b12f-fde66240b80d could not be found. Sep 06 01:31:02.632455 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:31:02.632455 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:31:02.632455 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:31:02.632455 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:31:02.632455 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:31:02.632455 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:31:02.632455 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:31:02.632455 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:31:02.632455 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 062259ef-5e29-4726-b12f-fde66240b80d could not be found. Sep 06 01:31:02.632455 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: ERROR nova.api.openstack.wsgi Sep 06 01:31:02.634275 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-40982487-7027-4b89-9ddf-1f20106a1578 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Returning 404 to user: Instance 062259ef-5e29-4726-b12f-fde66240b80d could not be found. {{(pid=120580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:31:02.634275 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-40982487-7027-4b89-9ddf-1f20106a1578 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "DELETE /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d" status: 404 len: 111 microversion: 2.1 time: 0.030188 Sep 06 01:31:02.634275 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 602/1172] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 6 01:31:02 2022] DELETE /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 01:31:02.637804 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4992b404-fdda-4e00-a8c3-71720867c6f2 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:31:02.638411 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4992b404-fdda-4e00-a8c3-71720867c6f2 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] [instance: 062259ef-5e29-4726-b12f-fde66240b80d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 01:31:02.644339 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4992b404-fdda-4e00-a8c3-71720867c6f2 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:31:02.644813 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4992b404-fdda-4e00-a8c3-71720867c6f2 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:31:02.645243 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4992b404-fdda-4e00-a8c3-71720867c6f2 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:31:02.645921 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4992b404-fdda-4e00-a8c3-71720867c6f2 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Acquiring lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 01:31:02.646372 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4992b404-fdda-4e00-a8c3-71720867c6f2 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 01:31:02.647280 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4992b404-fdda-4e00-a8c3-71720867c6f2 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Lock "aad59874-72ec-4cb0-bd6c-f8599f20aa58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 01:31:02.660206 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-4992b404-fdda-4e00-a8c3-71720867c6f2 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] HTTP exception thrown: Instance 062259ef-5e29-4726-b12f-fde66240b80d could not be found. Sep 06 01:31:02.661688 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4992b404-fdda-4e00-a8c3-71720867c6f2 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Request method failure captured: Sep 06 01:31:02.661688 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d HTTP/1.1 Sep 06 01:31:02.661688 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept: application/json Sep 06 01:31:02.661688 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Accept-Encoding: identity Sep 06 01:31:02.661688 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Connection: close Sep 06 01:31:02.661688 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Length: 0 Sep 06 01:31:02.661688 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Content-Type: application/json Sep 06 01:31:02.661688 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Host: 10.222.0.23 Sep 06 01:31:02.661688 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: Openstack-System-Scope: None Sep 06 01:31:02.661688 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Sep 06 01:31:02.661688 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjFqFUGRDtvP7kikq2u8OKAD3gLCAs2_SwVmWbc8V_RHR4nErzGcYvrFO-vyEdydLblKWwtXYvBtV3tVFqW3EWpy0-YMqKEle_KOqqbvCYoqVcEFz7Ca6sjNfy9srnZpYUdiZQr9y5YBjT5yBVEwBW_DIZ2zYbvapfTljIQhHgx6cpMkQ Sep 06 01:31:02.661688 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Id: None Sep 06 01:31:02.661688 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Domain-Name: None Sep 06 01:31:02.661688 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Identity-Status: Confirmed Sep 06 01:31:02.661688 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Is-Admin-Project: True Sep 06 01:31:02.661688 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Id: default Sep 06 01:31:02.661688 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Domain-Name: Default Sep 06 01:31:02.661688 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Id: 333491050689469789d7fd61b4d70cf8 Sep 06 01:31:02.661688 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Project-Name: tempest-TestVolumeBootPattern-2054739329 Sep 06 01:31:02.661688 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Role: reader,member Sep 06 01:31:02.661688 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Roles: reader,member Sep 06 01:31:02.664126 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/333491050689469789d7fd61b4d70cf8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/333491050689469789d7fd61b4d70cf8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_333491050689469789d7fd61b4d70cf8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/333491050689469789d7fd61b4d70cf8"}]}] Sep 06 01:31:02.664126 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant: tempest-TestVolumeBootPattern-2054739329 Sep 06 01:31:02.664126 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Id: 333491050689469789d7fd61b4d70cf8 Sep 06 01:31:02.664126 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-Tenant-Name: tempest-TestVolumeBootPattern-2054739329 Sep 06 01:31:02.664126 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User: tempest-TestVolumeBootPattern-2054739329-project Sep 06 01:31:02.664126 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Id: default Sep 06 01:31:02.664126 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Domain-Name: Default Sep 06 01:31:02.664126 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Id: e58ada13a75445df97d8b6d1e3ea9c50 Sep 06 01:31:02.664126 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: X-User-Name: tempest-TestVolumeBootPattern-2054739329-project Sep 06 01:31:02.664126 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: method: > Sep 06 01:31:02.664126 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: exception: Instance 062259ef-5e29-4726-b12f-fde66240b80d could not be found. Sep 06 01:31:02.664126 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: action_args: {'id': '062259ef-5e29-4726-b12f-fde66240b80d'} Sep 06 01:31:02.664926 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 01:31:02.664926 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:31:02.664926 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 01:31:02.664926 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 01:31:02.664926 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 01:31:02.664926 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 01:31:02.664926 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 01:31:02.664926 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 01:31:02.664926 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 01:31:02.664926 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 01:31:02.664926 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 062259ef-5e29-4726-b12f-fde66240b80d could not be found. Sep 06 01:31:02.664926 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:31:02.664926 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:31:02.664926 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:31:02.664926 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:31:02.664926 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:31:02.664926 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:31:02.664926 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 01:31:02.664926 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 01:31:02.664926 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 01:31:02.666221 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 01:31:02.666221 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 01:31:02.666221 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 01:31:02.666221 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 01:31:02.666221 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 01:31:02.666221 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 01:31:02.666221 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 01:31:02.666221 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 062259ef-5e29-4726-b12f-fde66240b80d could not be found. Sep 06 01:31:02.666221 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:31:02.666221 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 01:31:02.666221 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:31:02.666221 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 01:31:02.666221 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 01:31:02.666221 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 01:31:02.666221 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 01:31:02.666221 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 01:31:02.666221 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 062259ef-5e29-4726-b12f-fde66240b80d could not be found. Sep 06 01:31:02.666221 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Sep 06 01:31:02.668080 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4992b404-fdda-4e00-a8c3-71720867c6f2 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Returning 404 to user: Instance 062259ef-5e29-4726-b12f-fde66240b80d could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 01:31:02.668080 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4992b404-fdda-4e00-a8c3-71720867c6f2 tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "GET /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d" status: 404 len: 111 microversion: 2.1 time: 0.029669 Sep 06 01:31:02.668080 dv-cinder-847732-2-iscsi devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 571/1173] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 6 01:31:02 2022] GET /compute/v2.1/servers/062259ef-5e29-4726-b12f-fde66240b80d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 01:31:03.953562 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: DEBUG nova.api.openstack.wsgi [None req-f3a391e8-5602-4ffc-9fb4-0d70fd8f4dee tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] Calling method '.version_select at 0x7fb06e21fa60>' {{(pid=120580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 01:31:03.980901 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: INFO nova.api.openstack.requestlog [None req-f3a391e8-5602-4ffc-9fb4-0d70fd8f4dee tempest-TestVolumeBootPattern-2054739329 tempest-TestVolumeBootPattern-2054739329-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-635459421" status: 202 len: 0 microversion: 2.1 time: 0.031856 Sep 06 01:31:03.981489 dv-cinder-847732-2-iscsi devstack@n-api.service[120580]: [pid: 120580|app: 0|req: 603/1174] 10.222.0.23 () {58 vars in 1260 bytes} [Tue Sep 6 01:31:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-635459421 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)